• Stefy Lanza (nextime / spora )'s avatar
    colibri: GLM-5.2 tool-call parsing + treat colibri as a normal VRAM-eviction citizen · e2081488
    Stefy Lanza (nextime / spora ) authored
    - parser: add GLMParser + parse_glm_tool_calls/strip_glm_tool_calls for GLM-5.2's
      <tool_call>name<arg_key>k</arg_key><arg_value>v</arg_value>...</tool_call> format
      (byte-compatible with colibri's own parser). Gated on the <arg_key> marker so a
      generic <tool_call>{json} from other families is never hijacked. Declared-type
      coercion keeps string args verbatim (no "12345"->int). Unclosed-box recovery for
      budget-truncated calls. Wired into family selection ('glm'/'colibri'), the
      model-agnostic ToolCallParser path, and both strip_tool_calls_from_content paths.
    - manager: colibri no longer seizes the whole GPU like ds4. It pins only a
      configurable expert tier (CUDA_EXPERT_GB) and streams the rest, so it coexists and
      is evicted like any other model. VRAM footprint estimated from cuda_expert_gb
      (+overhead) until measured.
    
    Verified: typed/untyped parse, strip, unclosed recovery, non-GLM gating, and the
    by-name dispatcher all correct.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    e2081488
Name
Last commit
Last update
..
cache Loading commit data...
__init__.py Loading commit data...
acceleration.py Loading commit data...
capabilities.py Loading commit data...
gpu_lock.py Loading commit data...
gpu_query.py Loading commit data...
grammar.py Loading commit data...
hf_loading.py Loading commit data...
manager.py Loading commit data...
parser.py Loading commit data...
peft_compat.py Loading commit data...
pipeline_cache.py Loading commit data...
quant.py Loading commit data...
ram_monitor.py Loading commit data...
templates.py Loading commit data...
thermal.py Loading commit data...
tmp_janitor.py Loading commit data...
tool_call_grammar.gbnf Loading commit data...
turboquant.py Loading commit data...
utils.py Loading commit data...