• Stefy Lanza (nextime / spora )'s avatar
    manager: keep the requested id so sibling configs stay distinguishable · 484c88f4
    Stefy Lanza (nextime / spora ) authored
    The previous attempt at this didn't fire. request_model overwrites the requested
    name with the alias target on its first resolution step:
    
        if requested_model in self.model_aliases:
            requested_model = self.model_aliases[requested_model]
    
    so by the time anything looks a config up, 'lisa-32k' no longer exists — model_key
    and resolved_name are both the weights path, they compare equal, and the
    same-path-sibling check had nothing to compare. Confirmed live on 0.1.92: the
    second lisa-32k request still logged "need 52.0 GB VRAM, have 4.6 GB free" and
    evicted the model that was serving it.
    
    Keep the original id in _requested_id before that overwrite, hand it to
    ensure_vram_for at all three reservation sites, and let _get_model_used_vram_gb try
    it ahead of resolved_name. Against the live config: lisa-32k now sizes at 22.44 GB
    instead of lisa's 51.97 GB, and qwen38-128k at 19.50 instead of qwen38's 18.00.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    484c88f4
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...