• Stefy Lanza (nextime / spora )'s avatar
    runpod: an engines pod image — ds4, colibri, k3 compiled for every pod GPU · 1e093d27
    Stefy Lanza (nextime / spora ) authored
    The local ds4-server is an sm_86 build against CUDA 13 and the local
    colibri has no GPU backend: neither could be copied into a pod. The new
    engines image compiles both, plus kimi-k3-in-c, in a CUDA 12.8 stage for
    sm_80/86/89/90/120a (ds4's Blackwell kernels need the arch-specific
    target; plain sm_120 fails in ptxas) on a portable x86-64-v3 baseline,
    and fails the build if a binary cannot find its libraries.
    
    A RunPod-only model names the engine on its runpod block (backend:
    runpod takes the pin slot); a local model pinned to the engine and
    bursting carries the pin. Either way the pod arrives with the engine
    enabled and this install's settings forwarded (CODERAI_<ENG>_CONFIG),
    and volume_path points it at weights already on the network volume —
    the only sane way to run 150 GB+ models. The model page warns loudly
    the moment one of these engines is picked. ktransformers is refused
    with a reason: it has no pod image.
    
    Also: the batch build/publish scripts no longer list core-light and
    venv profiles as images.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    1e093d27
Name
Last commit
Last update
..
superpowers Loading commit data...
README.md Loading commit data...
deepseek-ds4.md Loading commit data...
dtype-auto-selection.md Loading commit data...
expressive-tts.md Loading commit data...
frontend-engine-split.md Loading commit data...
gguf-process-isolation.md Loading commit data...
glm-colibri.md Loading commit data...
kimi-k3.md Loading commit data...
ktransformers.md Loading commit data...
minimax-h3.md Loading commit data...
ocr.md Loading commit data...
process-isolation-plans.md Loading commit data...
reference-projects.md Loading commit data...
remote-execution.md Loading commit data...
reverse-proxy-nginx.md Loading commit data...
runpod.md Loading commit data...
tools-as-services.md Loading commit data...
vllm.md Loading commit data...
zimage-lora-training.md Loading commit data...