• Stefy Lanza (nextime / spora )'s avatar
    front: 'silent' wait-mode still keepalives (SSE comments), driven by the front · 595c3a9e
    Stefy Lanza (nextime / spora ) authored
    The point of the keepalive is to hold the client connection open while the engine
    is stuck loading — so 'silent' must NOT fall back to the dead legacy path (which
    sends nothing until the engine's first byte and lets short-timeout clients/proxies
    disconnect). Now ALL streaming inference goes through the front keepalive path:
    
      * silent    — SSE comment lines (': …') only: keeps the socket alive, emits no
                    chunk/content/status (invisible to event parsers).
      * invisible — empty-content chunk + x_queue_info (default).
      * visible   — visible status text.
      * thinking  — reasoning channel (when mode != silent).
    
    The front stays responsive even when the engine is GIL-blocked, so it can drive
    these regardless of engine state.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    595c3a9e
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...