• Stefy Lanza (nextime / spora )'s avatar
    let the eviction ladder see an image load while it runs · a3446118
    Stefy Lanza (nextime / spora ) authored
    The video path reserves a model's VRAM estimate for its whole load window so a
    concurrent load sees the card as spoken-for. The image path registered only a
    Tasks-page entry, so for as long as a load took, the card looked free.
    
    Measured 2026-10-28: Krea-2-RealDream held 18.8 GiB of a 23.56 GiB card for the
    194 s of its load, ensure_vram_for granted a CrisperWhisper reservation against
    VRAM that was already gone, and every captioned scene of a concurrent compose
    answered "CUDA out of memory. Tried to allocate 86.00 MiB". Both ends had been
    fixed in isolation -- the STT path reserves, the worker releases -- and neither
    helped, because the model they were negotiating over never declared itself.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZnLhydX9QqUcfBbqLu
    a3446118
test_crisperwhisper_vram_eviction.py 10.7 KB