• Stefy Lanza (nextime / spora )'s avatar
    manager: alias/bare name must reuse the loaded instance (was loading a 2nd despite max 1) · 83bc76d7
    Stefy Lanza (nextime / spora ) authored
    request_model's "already loaded?" fuzzy match compared basenames literally, so a
    bare request "gemma-…-Q4_0" missed the loaded "/AI/…/gemma-…-Q4_0.gguf" (the .gguf
    suffix differed) and a SECOND instance was loaded even with max_model_instances=1.
    A "lisa" alias resolved to the full path and matched, but the bare name didn't —
    so two requests for the same model (one via alias, one via name) ran as two
    instances instead of queueing on one. Normalize the .gguf extension (and compare
    short basenames) when matching, so every name form of one model maps to the same
    loaded instance and the second request queues.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    83bc76d7
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...