• Stefy Lanza (nextime / spora )'s avatar
    lora-train: evict co-located sibling engine's VRAM before training (fix OOM) · e300e9c4
    Stefy Lanza (nextime / spora ) authored
    LoRA training freed VRAM with unload_all_models(), which only unloads THIS
    engine's models. On the GGUF-isolation split the co-located gguf (text) engine
    kept its model resident (~7.4 GB), so fp32 training (~16 GB) + the sibling
    exceeded the 24 GB card → "CUDA out of memory. Tried to allocate 32 MiB … 26 MiB
    free … Process 226 has 7.36 GiB" — every fighter LoRA (dlaba, zigo, zlo, …)
    failed. Training also isn't covered by the front swap-gate, so nothing else
    cleared the sibling.
    
    Add multi_model_manager.evict_cosited_siblings(): invoke the registered
    cross-engine VRAM releasers (the cosite releaser posts wait=True, so it waits for
    a busy sibling to reach a safe point). Call it right after unload_all_models() in
    both training paths (image + video/Wan), so training gets the whole card.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    e300e9c4
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...