• Stefy Lanza (nextime / spora )'s avatar
    broker: also retry on connection failure + transient 5xx, not just engine-None · cfe21d56
    Stefy Lanza (nextime / spora ) authored
    The first pass only retried when pick_engine returned no engine or the engine
    returned a non-200. But the real empty-reply case is a CONNECTION failure: during
    the engine startup/restart window the engine process isn't accepting yet, so
    self._long.send raises "All connection attempts failed" — caught by the outer
    except and relayed as a single empty SSE chunk (chunks=1) over the broker.
    
    Move the send inside the retry loop on both broker paths (streaming + buffered):
    retry on a connection exception and on not-ready statuses (425/429/500/502/503/504),
    attempt-bound (6 x 5s), and only surface the error once exhausted. A 4xx is a real
    client error and is still relayed as-is. Confirmed against debug.log: all failures
    were in the engine-startup window; requests after the engine came up streamed fine.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01RdMufYvtTbtGDWsiZVoXce
    cfe21d56
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...