• Stefy Lanza (nextime / spora )'s avatar
    lora-train: evict co-located sibling engine's VRAM before training (fix OOM) · e300e9c4
    Stefy Lanza (nextime / spora ) authored
    LoRA training freed VRAM with unload_all_models(), which only unloads THIS
    engine's models. On the GGUF-isolation split the co-located gguf (text) engine
    kept its model resident (~7.4 GB), so fp32 training (~16 GB) + the sibling
    exceeded the 24 GB card → "CUDA out of memory. Tried to allocate 32 MiB … 26 MiB
    free … Process 226 has 7.36 GiB" — every fighter LoRA (dlaba, zigo, zlo, …)
    failed. Training also isn't covered by the front swap-gate, so nothing else
    cleared the sibling.
    
    Add multi_model_manager.evict_cosited_siblings(): invoke the registered
    cross-engine VRAM releasers (the cosite releaser posts wait=True, so it waits for
    a busy sibling to reach a safe point). Call it right after unload_all_models() in
    both training paths (image + video/Wan), so training gets the whole card.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    e300e9c4
Name
Last commit
Last update
..
cache Loading commit data...
__init__.py Loading commit data...
acceleration.py Loading commit data...
capabilities.py Loading commit data...
gpu_query.py Loading commit data...
grammar.py Loading commit data...
hf_loading.py Loading commit data...
manager.py Loading commit data...
parser.py Loading commit data...
peft_compat.py Loading commit data...
pipeline_cache.py Loading commit data...
quant.py Loading commit data...
ram_monitor.py Loading commit data...
templates.py Loading commit data...
thermal.py Loading commit data...
tmp_janitor.py Loading commit data...
tool_call_grammar.gbnf Loading commit data...
turboquant.py Loading commit data...
utils.py Loading commit data...