• Stefy Lanza (nextime / spora )'s avatar
    manager: canonicalize GGUF model_key to the file path (concurrent-race instance dedup) · c53ad452
    Stefy Lanza (nextime / spora ) authored
    Harden the max-instances guard against the concurrent case: request_model now
    resolves a GGUF text model to its absolute .gguf path (via _resolve_local_gguf)
    before building model_key, so every name form — bare id, basename.gguf, full path,
    or alias (e.g. "lisa") — collapses to ONE model_key. That gives a single
    self.models entry and a single instance pool, so two simultaneous first-requests
    under different forms converge on the same pool and the second queues instead of
    loading a second instance. Complements the earlier already-loaded fuzzy match
    (which only covered the sequential case).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    c53ad452
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...