• Your Name's avatar
    Pre-load all model types at startup for loadall/loadswap modes · bc2b1388
    Your Name authored
    - loadall: pre-load image models into VRAM at startup (with OOM fallback)
    - loadswap: pre-load image models into CPU RAM at startup (first model stays in VRAM)
    - Audio and TTS models are cached at startup, loaded into memory on first request
      (they use specialized loading mechanisms via faster-whisper and kokoro)
    bc2b1388
Name
Last commit
Last update
..
api Loading commit data...
backends Loading commit data...
models Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
main.py Loading commit data...