• Stefy Lanza (nextime / spora )'s avatar
    let the eviction ladder see an image load while it runs · a3446118
    Stefy Lanza (nextime / spora ) authored
    The video path reserves a model's VRAM estimate for its whole load window so a
    concurrent load sees the card as spoken-for. The image path registered only a
    Tasks-page entry, so for as long as a load took, the card looked free.
    
    Measured 2026-10-28: Krea-2-RealDream held 18.8 GiB of a 23.56 GiB card for the
    194 s of its load, ensure_vram_for granted a CrisperWhisper reservation against
    VRAM that was already gone, and every captioned scene of a concurrent compose
    answered "CUDA out of memory. Tried to allocate 86.00 MiB". Both ends had been
    fixed in isolation -- the STT path reserves, the worker releases -- and neither
    helped, because the model they were negotiating over never declared itself.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZnLhydX9QqUcfBbqLu
    a3446118
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
cluster Loading commit data...
compose Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
ocr Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
util Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
hf_cache.py Loading commit data...
main.py Loading commit data...
ocr_fleet_workers.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...