• Stefy Lanza (nextime / spora )'s avatar
    multi-engine: live /v1/models on config change + accept gguf-stem ids · 79c2e44d
    Stefy Lanza (nextime / spora ) authored
    Two bugs made a freshly-configured model unusable until a full restart on a
    multi-engine node:
    
    1. Name mismatch: list_models advertises a gguf's filename WITHOUT .gguf as an
       id, but get_all_allowed_identifiers only allowed the name WITH .gguf, so a
       request using the id from /v1/models was 404'd as "not an allowed model".
       Now the .gguf-stripped stem is allowed too.
    
    2. Stale per-engine assignment: each engine's /v1/models is filtered by the
       assignment set fixed at startup, and secondary engines never re-read
       models.json — so an added/removed model didn't show up or route until
       restart. The front now watches models.json mtime, recomputes the
       assignment, updates its router, and pushes it to every engine via a new
       internal POST /internal/reload-config (re-reads models.json +
       set_assigned_models). /v1/models and routing now reflect add/remove live.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    79c2e44d
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...