• Stefy Lanza (nextime / spora )'s avatar
    runpod: tell a capability pod what it may serve · ee879bef
    Stefy Lanza (nextime / spora ) authored
    The first pod that survived long enough to answer returned:
    "Model 'bge-m3' is not available. Use one of: " — nothing after the
    colon. A pod starts with an EMPTY catalogue. A per-model pod is seeded
    with its one model, but a capability pod has no model entry at all, so it
    refused everything.
    
    Capability pods are now seeded with this deployment's models OF THAT
    CAPABILITY — only ones the pod can actually fetch (a HuggingFace repo id
    or a URL), since registering a local path would turn a clear "not
    available" into a confusing load failure.
    
    The seeding was also unreachable for any pod with an explicit image: the
    coderai branch returned early only when the image was UNSET, and
    capability pods always have one now (the published default). Both cases
    go through one path that carries the auth token and the catalogue
    together.
    
    What the live run did prove, before failing on the catalogue: GPU
    selection with price ranking and capacity fallback, the boot health gate,
    pod bearer auth (our token accepted; an unauthenticated call gets 401),
    gateway forwarding to the pod URL, idle reaping after 120s, and the spend
    ledger ($0.033 for the run).
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    ee879bef
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...