• Stefy Lanza (nextime / spora )'s avatar
    colibri/k3: give the mux engines a remote service too · 85f0f53d
    Stefy Lanza (nextime / spora ) authored
    These two were the exception in the last commit: they are driven over a
    stdin/stdout mux protocol, so there was no URL to redirect. This adds the
    missing HTTP boundary.
    
    tools/mux_service.py hosts a real MuxEngine (colibri or k3 — both use the
    same class) and exposes /health, /run (NDJSON: text chunks then stats),
    /pause and /resume. codai/api/mux_remote.RemoteMuxEngine is the client
    and presents the exact surface the backends use — run/is_alive/pause/
    resume/close/log_tail/family — so ensure_engine() can hand one back and
    nothing downstream can tell local from remote. Cancellation travels as a
    dropped connection: the service's write fails and it stops generating,
    matching the local `cancelled` callback semantics.
    
    `service_url` is now a real config field on all five engine backends
    (ds4, colibri, k3, ktransformers, vllm), settable through the admin API
    and persisted, rather than only an env var.
    
    Tested end-to-end against a stub engine: streaming, stats, mid-stream
    cancellation, pause/resume, and error propagation all round-trip.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    85f0f53d
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...