• Stefy Lanza (nextime / spora )'s avatar
    teach a pod the ENGINE too, or it falls through to "cpu" (v0.4.70) · 10d2e4fa
    Stefy Lanza (nextime / spora ) authored
    digesta-alpha, reproducible on a fresh pod:
    
      [boot +0.8s] seeded models registered: qwen38-awq, diogene-alpha,
                   digesta-alpha, qwen38-vision          <- correct
      Resolving model: digesta-alpha
      [register] digesta-alpha registered in text_models <- teach, overwriting it
      [lora] added 'digesta-alpha' to the running engine — no reload
      Loading model on demand: digesta-alpha
      Warning: No GPU backend detected.
      Error loading model digesta-alpha: Unknown backend: cpu
    
    seed_model_env strips `backend` unless told the engine: a RunPod model carries
    `backend: "runpod"`, which is THIS install's placement and means nothing on a
    pod. The SEED path has passed the engine since the same fault bit diogene-alpha
    (the reason is written beside that call). teach_model never did.
    
    So the model was seeded correctly at boot and then RE-REGISTERED by teach --
    which happens whenever an adapter has to be sent -- and the good entry was
    replaced by a backend-less one. It worked until something taught it, which is
    why it read as intermittent, and why diogene-alpha on the same pod was fine:
    nothing re-taught it.
    
    Orchestrator-side, so a pod already holding a broken registration can be
    re-taught in place rather than replaced.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01S8LAP3ueNzQJtwzhgVbq66
    10d2e4fa
remote_gateway.py 67 KB