• Stefy Lanza (nextime / spora )'s avatar
    video: fix VRAM teardown leak + track in-flight loads with reservations · 2ea24b0b
    Stefy Lanza (nextime / spora ) authored
    Teardown leak: _free_pipeline_vram now records the pipeline's CUDA
    storage pointers up front and, after the normal teardown+gc, walks
    gc.get_objects() and nulls any surviving tensors out of their list/dict
    referrers (the proven pass from the CUDA text backend's cleanup) — the
    "~22 GB untracked (teardown leak; referenced elsewhere)" VRAM is now
    reclaimed instead of poisoning every later load until a restart. Names
    the holders when it fires so future leak sources identify themselves.
    
    Tracking: a video pipeline only registers in manager.models AFTER its
    multi-minute load, so concurrent loads raced the free-VRAM check into
    mutual OOM. note_loading()/clear_loading() reserve the model's estimate
    for the whole load window; _get_free_vram_gb subtracts reservations and
    the orphan-VRAM check counts them (no more false "teardown leak" for an
    in-progress load). The embeddings OOM-retry waits out active
    reservations (bounded 300s) before evicting and retrying.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014S8VtAvG499SsCbeESRK7V
    2ea24b0b
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...