• Stefy Lanza (nextime / spora )'s avatar
    front: don't flag a busy-but-alive engine as "not responding" during generation · 021e41ec
    Stefy Lanza (nextime / spora ) authored
    The supervisor health-polls /internal/engine-state every couple seconds. While the
    engine is GIL-busy generating, that poll can't be answered in time and the engine
    was flipped to healthy=False — flapping out of the UI/routing mid-generation even
    though it's perfectly alive. Now a poll timeout only downgrades health when the
    PROCESS IS GONE (true death, already caught by the restart check); a timeout with
    the process alive keeps the last-known-healthy state. Also bump proxy_status_timeout
    2s→4s so transient GIL contention doesn't trip it. (Pairs with the engine-state
    VRAM cache that removed the per-poll CUDA call.)
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    021e41ec
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...