• Stefy Lanza (nextime / spora )'s avatar
    ocr: a pipeline asks where the engine is, and a node is one of the answers · 2f20f8e9
    Stefy Lanza (nextime / spora ) authored
    Everywhere else in coderai an engine is what RUNS a model. `ocr.default_engine`
    borrows the word for two different kinds of thing: paddle and docTR are runners
    with their own weights, while surya-2 and olmOCR are pipelines over a model that
    vLLM runs. Only the second kind has to be told where a server is — and that is
    the same question the model layer already answers for everything else.
    
    So answer it in all the places a model can actually be served. A cluster node
    was the one that was missing: a node is a whole coderai registered with the head
    as a remote ENGINE, so nothing in the backend layer knows it exists, and a VLM
    hosted there came back as "not served over HTTP" from an install that was
    serving it perfectly well. The node's own catalogue is the authority, so it is
    asked. An explicit backend pin still wins — discovery is the fallback, not an
    override — and the nodes are not probed at all when clustering is off, which
    would have added a timeout to the first page of every document.
    
    Also: one test here was passing for the wrong reason. `from codai.models import
    manager` reads the package attribute and never consults sys.modules, so a fake
    installed there was simply not seen. Patched as attributes of the real module,
    which is what made the precedence test fail honestly.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01PxYHWbCAjjjD7A1rhFKtaW
    2f20f8e9
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...