• Stefy Lanza (nextime / spora )'s avatar
    workers: let every isolated-venv worker point at a remote service · 4766c1df
    Stefy Lanza (nextime / spora ) authored
    Each `ensure_service()` already returns a base URL, so a worker can be
    pointed at a service running elsewhere — another host, a container, a
    rented RunPod pod — without anything downstream noticing. Only the TTS
    backends had that escape hatch (parler/melo, checked at the caller);
    now the check lives in the workers themselves, per-model via
    `service_url` in the config plus a CODERAI_*_SERVICE_URL env var:
    
      vllm, ds4, kt, h3, pyannote, melotts, canary, crisperwhisper, parler
    
    Each verifies the remote's health check before returning it, so a stale
    or wrong URL fails loudly instead of surfacing as a confusing timeout
    later. vLLM additionally checks that the remote actually serves the
    requested model — the OCR path asks for surya-2 by name, and a generic
    remote vLLM would otherwise be proxied silently.
    
    colibri/k3 are left out: they speak a stdin/stdout mux protocol, not
    HTTP, so there is no URL to redirect.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    4766c1df
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...