• Stefy Lanza (nextime / spora )'s avatar
    docs: the orchestrator is the FULL image — a capability image is a pod · 0c64b5b7
    Stefy Lanza (nextime / spora ) authored
    The guide told the operator to install ghcr.io/nextime/coderai-ocr as the
    orchestrator. That is backwards and it is the mistake the Digesta bring-up
    actually made: a capability image is a POD, what CoderAI rents and launches,
    and it has no GUI; its admin pages are not behind the API's bearer check, so
    it is not something to expose either.
    
    Rewritten around the full image on port 8776, with the two settings a
    GPU-less host needs and the reason each one is needed:
    
    - backend.type must be "cpu", not "auto": with auto, main.py searches
      nvidia/vulkan/opencl and exits "No supported backend detected" when it
      finds none. Set explicitly, that search is skipped.
    - engine_specs must name the engine: left to auto-detect, the front creates
      a no-GPU engine NAMED cpu but launches it with backend="auto"
      (engine_supervisor.py:311), which hits the same abort whatever
      backend.type says. That is why the log reads "[cpu] Available backends:
      {'cpu': True}" and then "No supported backend detected" — [cpu] is the
      name, auto was the backend.
    
    Also states that server.engines=0 means AUTO (one per GPU, min 1), that no
    "zero engines" setting exists, and that you do not want one: the RunPod
    pools, scaler and reaper live inside the primary engine, so one idle CPU
    engine is the component that manages the pods, not a workaround.
    
    Service examples, the upgrade section and the reference table all follow.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    0c64b5b7
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...