• Stefy Lanza (nextime / spora )'s avatar
    runpod: make a seeded model actually usable, and stop the double rent · 86e55c4f
    Stefy Lanza (nextime / spora ) authored
    The pod finally answered, and answered "Model 'bge-m3' is not available.
    Use one of: " — with NOTHING after the colon, despite being seeded with
    five models and successfully taught a sixth.
    
    Two causes, both only visible on a real pod.
    
    REGISTERING A MODEL WAS HALF DONE. Both the boot seed and
    /v1/models/register wrote models_data, but request validation asks the
    MODEL MANAGER for its allowed identifiers. A model in the catalogue that
    the manager never heard of is refused. Registration now calls the right
    setter per section, maps the alias a request actually uses (bge-m3 ->
    BAAI/bge-m3), and widens the engine's assigned-model set — a model
    registered at runtime was assigned by nobody and would otherwise be
    usable but invisible.
    
    AND THE SEED WAS FILTERED OUT BEFORE IT GOT THERE. A pod runs front plus
    engine; the front computes each engine's assignment from models.json, and
    the seed is deliberately in-memory only, so the engine was told to
    register nothing — dropping exactly the models the pod was rented for.
    Seeded entries now survive that filter.
    
    Separately: both engines rented their own pod again, 45 seconds apart,
    because a pod takes ~2.5 minutes to boot and the sharing check only saw
    READY pods. A pod is now registered at creation, and a sibling that finds
    one still booting WAITS for it instead of renting a second card.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    86e55c4f
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
ocr Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...