• Stefy Lanza (nextime / spora )'s avatar
    front: keep an engine's models listed while it's mid-load · 1c57629b
    Stefy Lanza (nextime / spora ) authored
    collect_models unioned only registry.healthy() engines and re-fetched
    each engine's /v1/models live. An engine loading a model is GIL-blocked
    and misses the 2s health poll, so it goes "unhealthy" and ALL its models
    — including a freshly-added one — drop out of the aggregated /v1/models
    until the load finishes. A client (e.g. the kilo model script) polling
    during a load then sees models vanish. Cache each engine's last-good
    /v1/models and, when it's transiently unhealthy/unreachable, serve that
    cached list instead of dropping it. The models are still assigned to the
    engine and will serve once it's free.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    1c57629b
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...