Add --tiny flag for tiny model support in coder CLI

- Add --tiny command line flag for models under 3B parameters
- Add 'tiny' field to config file (can be set via config or CLI)
- Add TINY_MODEL_SYSTEM_PROMPT with simplified instructions
- Emphasizes spacing rules for models that produce garbled output
- Shorter, more direct system prompt for limited context windows
parent 74db6667
...@@ -764,7 +764,8 @@ Examples: ...@@ -764,7 +764,8 @@ Examples:
'api_url': config.api_url, 'api_url': config.api_url,
'token': config.token, 'token': config.token,
'system_prompt': config.system_prompt, 'system_prompt': config.system_prompt,
'model': config.model 'model': config.model,
'tiny': config.tiny
}, indent=2)) }, indent=2))
return return
...@@ -776,6 +777,13 @@ Examples: ...@@ -776,6 +777,13 @@ Examples:
config.api_url = args.api_url config.api_url = args.api_url
if args.token: if args.token:
config.token = args.token config.token = args.token
if args.tiny:
config.tiny = True
# Apply tiny model system prompt if enabled
if config.tiny:
config.system_prompt = TINY_MODEL_SYSTEM_PROMPT
print("[Tiny model mode enabled - using simplified system prompt]")
# Create client # Create client
client = CoderClient(config) client = CoderClient(config)
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment