• Stefy Lanza (nextime / spora )'s avatar
    manager: canonicalize GGUF model_key to the file path (concurrent-race instance dedup) · c53ad452
    Stefy Lanza (nextime / spora ) authored
    Harden the max-instances guard against the concurrent case: request_model now
    resolves a GGUF text model to its absolute .gguf path (via _resolve_local_gguf)
    before building model_key, so every name form — bare id, basename.gguf, full path,
    or alias (e.g. "lisa") — collapses to ONE model_key. That gives a single
    self.models entry and a single instance pool, so two simultaneous first-requests
    under different forms converge on the same pool and the second queues instead of
    loading a second instance. Complements the earlier already-loaded fuzzy match
    (which only covered the sequential case).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    c53ad452
Name
Last commit
Last update
..
cache Loading commit data...
__init__.py Loading commit data...
acceleration.py Loading commit data...
capabilities.py Loading commit data...
grammar.py Loading commit data...
hf_loading.py Loading commit data...
manager.py Loading commit data...
parser.py Loading commit data...
pipeline_cache.py Loading commit data...
quant.py Loading commit data...
ram_monitor.py Loading commit data...
templates.py Loading commit data...
thermal.py Loading commit data...
tmp_janitor.py Loading commit data...
tool_call_grammar.gbnf Loading commit data...
turboquant.py Loading commit data...
utils.py Loading commit data...