• Stefy Lanza (nextime / spora )'s avatar
    colibri: GLM-5.2 tool-call parsing + treat colibri as a normal VRAM-eviction citizen · e2081488
    Stefy Lanza (nextime / spora ) authored
    - parser: add GLMParser + parse_glm_tool_calls/strip_glm_tool_calls for GLM-5.2's
      <tool_call>name<arg_key>k</arg_key><arg_value>v</arg_value>...</tool_call> format
      (byte-compatible with colibri's own parser). Gated on the <arg_key> marker so a
      generic <tool_call>{json} from other families is never hijacked. Declared-type
      coercion keeps string args verbatim (no "12345"->int). Unclosed-box recovery for
      budget-truncated calls. Wired into family selection ('glm'/'colibri'), the
      model-agnostic ToolCallParser path, and both strip_tool_calls_from_content paths.
    - manager: colibri no longer seizes the whole GPU like ds4. It pins only a
      configurable expert tier (CUDA_EXPERT_GB) and streams the rest, so it coexists and
      is evicted like any other model. VRAM footprint estimated from cuda_expert_gb
      (+overhead) until measured.
    
    Verified: typed/untyped parse, strip, unclosed recovery, non-GLM gating, and the
    by-name dispatcher all correct.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    e2081488
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...