• Stefy Lanza (nextime / spora )'s avatar
    image: ship a C compiler, or vLLM never starts (v0.2.62) · 8393a10e
    Stefy Lanza (nextime / spora ) authored
    Why a remote host was sending PaddleOCR requests: surya never ran. Every attempt
    ended as
    
      [ocr] engine 'surya' could not serve (vLLM exited (code 1) before becoming
      ready) … falling back to paddle -> doctr
    
    and the root cause, four frames down in the vLLM subprocess output:
    
      RuntimeError: Failed to find C compiler. Please specify via CC environment
      variable or set triton.knobs.build.impl.
    
    Triton JIT-compiles its CUDA driver module at RUNTIME, on first engine start. The
    image has no cc, gcc or clang — confirmed by looking inside it; the single dpkg
    match is gcc-*-base, runtime libs, not a compiler. So gcc and libc6-dev are now
    installed in the shipped stage, with the reason recorded beside them: a compiler
    in a runtime image looks like an obvious thing to delete.
    
    This affects EVERY vLLM engine, not just OCR.
    
    What made it invisible: the OCR fallback chain worked. All 203 /v1/ocr requests in
    the window returned 200 — on paddle, 218 times, after surya failed. Nothing in the
    HTTP log said anything was wrong, and the only outward sign was a remote host
    preferring an engine it should not have needed.
    
    The RunPod vLLM capability profile has carried gcc from the start. The main image
    never did. The test checks both so they cannot drift apart again.
    
    Needs a rebuild to take effect — a compiler cannot be bind-mounted in like the
    Python fixes.
    
    4 tests.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    8393a10e
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...