• Stefy Lanza (nextime / spora )'s avatar
    runpod: a seeded pod filed every model under text (v0.3.83) · 02a58b2c
    Stefy Lanza (nextime / spora ) authored
    In models.json a model's kind is the dict KEY it sits under. Only the
    ENTRY travels to a pod, and the pod's seeder reads
    
        section = e.get("model_type") or "text_models"
    
    A models.json entry carries no `model_type` -- so every capability pod
    registered every seeded model as a TEXT model, whatever it was.
    
    Found on a real A40 immediately after the gateway fix finally let a
    request reach a pod. It booted in 303s, served /v1/models, listed
    BAAI/bge-m3, and answered:
    
        Model 'BAAI/bge-m3' is a text model and cannot be used for embedding
        generation. Use the text endpoint instead.
    
    Which is the expensive part: nothing looks broken. The routing is right,
    the image is right, the catalogue is right, and the error blames the
    caller for calling the wrong endpoint.
    
    Both seed builders now carry the section -- `capability_seed_entries`
    already had it and dropped it at `out.append(entry)`, and
    `seed_model_env` gets it from the new `entry_model_type()` (by identity,
    then by id, "" on any failure). Stamped on a COPY, so nothing writes a
    field into models.json that this install never had, and an entry that
    already declares its own `model_type` is not second-guessed.
    
    Text pods were unaffected, which is why this survived: a vLLM pod serves
    text, and OCR engines are picked by name rather than registered at all.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01HXRMe9ZPUQCCCtBai9uqt3
    02a58b2c
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
third_party Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-longcat-train.txt Loading commit data...
requirements-longcat.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...