• Stefy Lanza (nextime / spora )'s avatar
    front: 'silent' wait-mode still keepalives (SSE comments), driven by the front · 595c3a9e
    Stefy Lanza (nextime / spora ) authored
    The point of the keepalive is to hold the client connection open while the engine
    is stuck loading — so 'silent' must NOT fall back to the dead legacy path (which
    sends nothing until the engine's first byte and lets short-timeout clients/proxies
    disconnect). Now ALL streaming inference goes through the front keepalive path:
    
      * silent    — SSE comment lines (': …') only: keeps the socket alive, emits no
                    chunk/content/status (invisible to event parsers).
      * invisible — empty-content chunk + x_queue_info (default).
      * visible   — visible status text.
      * thinking  — reasoning channel (when mode != silent).
    
    The front stays responsive even when the engine is GIL-blocked, so it can drive
    these regardless of engine state.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    595c3a9e
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...