• Stefy Lanza (nextime / spora )'s avatar
    give two models sharing a weights path their own cache slot · b7b32ea4
    Stefy Lanza (nextime / spora ) authored
    The silent one. self.models is keyed by model_key, and model_key was the
    weights path -- so two entries naming the same path shared ONE resident
    pipeline. LTX-2.3-PinkCherry requested while LTX-2.3-10Eros was resident never
    loaded its own transformer: no load, no eviction, straight to generation, and
    HTTP 200 with 10Eros weights. Every other instance of this family failed
    loudly; this one answered successfully with the wrong model.
    
    It also meant both wrote measured_vram_gb to the same key, so a Q4_K_M and a
    Q5_K_M of different sizes were overwriting each other sizing.
    
    A key is split only when the caller named something, two or more DISTINCT
    aliases point at that same path, and the named one is among them. A lone
    aliased model, or a request that names the path, keeps the key it has always
    had.
    
    That narrowness is the point, not caution for its own sake: collapsing every
    name form onto one key is deliberate a few lines above -- without it two
    concurrent first-requests under different spellings each load an instance and
    exceed max_model_instances=1. This is not a licence to key by whatever the
    caller typed.
    
    Verified live: the estimator now reports key=video:LTX-2.3-10Eros where both
    models previously shared key=video:diffusers/LTX-2.3-Diffusers.
    
    Suite: 15 failed, 5268 passed -- the same 15 as the baseline.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZnmWyKjWZerwsb27jZ
    b7b32ea4
Name
Last commit
Last update
..
cache Loading commit data...
__init__.py Loading commit data...
acceleration.py Loading commit data...
capabilities.py Loading commit data...
chat_style.py Loading commit data...
diffusion_loras.py Loading commit data...
gpu_lock.py Loading commit data...
gpu_query.py Loading commit data...
grammar.py Loading commit data...
hf_loading.py Loading commit data...
manager.py Loading commit data...
parser.py Loading commit data...
peft_compat.py Loading commit data...
pipeline_cache.py Loading commit data...
placement.py Loading commit data...
prompt_weighting.py Loading commit data...
quant.py Loading commit data...
ram_monitor.py Loading commit data...
remote_code.py Loading commit data...
templates.py Loading commit data...
text_loras.py Loading commit data...
textual_inversion.py Loading commit data...
thermal.py Loading commit data...
tmp_janitor.py Loading commit data...
tool_call_grammar.gbnf Loading commit data...
turboquant.py Loading commit data...
utils.py Loading commit data...
video_geometry.py Loading commit data...
weight_stores.py Loading commit data...