• Stefy Lanza (nextime / spora )'s avatar
    runpod: make the next pod failure diagnosable from the answer · 7c78c5fb
    Stefy Lanza (nextime / spora ) authored
    The last three pod failures were each diagnosed the same way: find the
    pod URL in the engine log, ask the pod by hand what it serves, work
    backwards. That is a diagnosis loop measured in minutes of log
    archaeology per attempt.
    
    Boot is now reported in PHASES, because "it took 150s" is not a
    diagnosis: port open after Ns (image pull + container start), serving
    after N more. The two have different fixes — a bigger boot_timeout_s
    versus a bigger load_timeout_s.
    
    The moment a pod is up, its /v1/models is logged. An empty catalogue now
    says so outright — "pod serves NO models — it will refuse every request"
    — instead of surfacing minutes later as "Model 'x' is not available. Use
    one of: " with nothing after the colon.
    
    And a test run's answer carries the pod diagnostics: which pods are live,
    their GPU, uptime, spend so far, URL, and the models each one lists. The
    fact that mattered in every failure so far was the catalogue, and it is
    now in the response rather than three commands away.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    7c78c5fb
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...