• Stefy Lanza (nextime / spora )'s avatar
    runpod: make a seeded model actually usable, and stop the double rent · 86e55c4f
    Stefy Lanza (nextime / spora ) authored
    The pod finally answered, and answered "Model 'bge-m3' is not available.
    Use one of: " — with NOTHING after the colon, despite being seeded with
    five models and successfully taught a sixth.
    
    Two causes, both only visible on a real pod.
    
    REGISTERING A MODEL WAS HALF DONE. Both the boot seed and
    /v1/models/register wrote models_data, but request validation asks the
    MODEL MANAGER for its allowed identifiers. A model in the catalogue that
    the manager never heard of is refused. Registration now calls the right
    setter per section, maps the alias a request actually uses (bge-m3 ->
    BAAI/bge-m3), and widens the engine's assigned-model set — a model
    registered at runtime was assigned by nobody and would otherwise be
    usable but invisible.
    
    AND THE SEED WAS FILTERED OUT BEFORE IT GOT THERE. A pod runs front plus
    engine; the front computes each engine's assignment from models.json, and
    the seed is deliberately in-memory only, so the engine was told to
    register nothing — dropping exactly the models the pod was rented for.
    Seeded entries now survive that filter.
    
    Separately: both engines rented their own pod again, 45 seconds apart,
    because a pod takes ~2.5 minutes to boot and the sharing check only saw
    READY pods. A pod is now registered at creation, and a sibling that finds
    one still booting WAITS for it instead of renting a second card.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    86e55c4f
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...