• Stefy Lanza (nextime / spora )'s avatar
    multi-engine: live /v1/models on config change + accept gguf-stem ids · 79c2e44d
    Stefy Lanza (nextime / spora ) authored
    Two bugs made a freshly-configured model unusable until a full restart on a
    multi-engine node:
    
    1. Name mismatch: list_models advertises a gguf's filename WITHOUT .gguf as an
       id, but get_all_allowed_identifiers only allowed the name WITH .gguf, so a
       request using the id from /v1/models was 404'd as "not an allowed model".
       Now the .gguf-stripped stem is allowed too.
    
    2. Stale per-engine assignment: each engine's /v1/models is filtered by the
       assignment set fixed at startup, and secondary engines never re-read
       models.json — so an added/removed model didn't show up or route until
       restart. The front now watches models.json mtime, recomputes the
       assignment, updates its router, and pushes it to every engine via a new
       internal POST /internal/reload-config (re-reads models.json +
       set_assigned_models). /v1/models and routing now reflect add/remove live.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    79c2e44d
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
characters.py Loading commit data...
custom_pipelines.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
images.py Loading commit data...
log.py Loading commit data...
loras.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
ratelimit.py Loading commit data...
spatial.py Loading commit data...
state.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...