• Stefy Lanza (nextime / spora )'s avatar
    colibri: GLM-5.2 tool-call parsing + treat colibri as a normal VRAM-eviction citizen · e2081488
    Stefy Lanza (nextime / spora ) authored
    - parser: add GLMParser + parse_glm_tool_calls/strip_glm_tool_calls for GLM-5.2's
      <tool_call>name<arg_key>k</arg_key><arg_value>v</arg_value>...</tool_call> format
      (byte-compatible with colibri's own parser). Gated on the <arg_key> marker so a
      generic <tool_call>{json} from other families is never hijacked. Declared-type
      coercion keeps string args verbatim (no "12345"->int). Unclosed-box recovery for
      budget-truncated calls. Wired into family selection ('glm'/'colibri'), the
      model-agnostic ToolCallParser path, and both strip_tool_calls_from_content paths.
    - manager: colibri no longer seizes the whole GPU like ds4. It pins only a
      configurable expert tier (CUDA_EXPERT_GB) and streams the rest, so it coexists and
      is evicted like any other model. VRAM footprint estimated from cuda_expert_gb
      (+overhead) until measured.
    
    Verified: typed/untyped parse, strip, unclosed recovery, non-GLM gating, and the
    by-name dispatcher all correct.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    e2081488
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...