• Stefy Lanza (nextime / spora )'s avatar
    runpod: an engines pod image — ds4, colibri, k3 compiled for every pod GPU · 1e093d27
    Stefy Lanza (nextime / spora ) authored
    The local ds4-server is an sm_86 build against CUDA 13 and the local
    colibri has no GPU backend: neither could be copied into a pod. The new
    engines image compiles both, plus kimi-k3-in-c, in a CUDA 12.8 stage for
    sm_80/86/89/90/120a (ds4's Blackwell kernels need the arch-specific
    target; plain sm_120 fails in ptxas) on a portable x86-64-v3 baseline,
    and fails the build if a binary cannot find its libraries.
    
    A RunPod-only model names the engine on its runpod block (backend:
    runpod takes the pin slot); a local model pinned to the engine and
    bursting carries the pin. Either way the pod arrives with the engine
    enabled and this install's settings forwarded (CODERAI_<ENG>_CONFIG),
    and volume_path points it at weights already on the network volume —
    the only sane way to run 150 GB+ models. The model page warns loudly
    the moment one of these engines is picked. ktransformers is refused
    with a reason: it has no pod image.
    
    Also: the batch build/publish scripts no longer list core-light and
    venv profiles as images.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    1e093d27
Name
Last commit
Last update
..
audio.build-deps Loading commit data...
audio.nodeps Loading commit data...
audio.txt Loading commit data...
core-light.txt Loading commit data...
core.txt Loading commit data...
embeddings.txt Loading commit data...
engines.dockerfile Loading commit data...
engines.txt Loading commit data...
faceswap.txt Loading commit data...
images.txt Loading commit data...
ocr-paddle.light Loading commit data...
ocr-paddle.txt Loading commit data...
ocr-paddle.venv-paddleocr.txt Loading commit data...
ocr.txt Loading commit data...
speaker.light Loading commit data...
speaker.txt Loading commit data...
speaker.venv-pyannote.check Loading commit data...
speaker.venv-pyannote.txt Loading commit data...
stt-crisper.light Loading commit data...
stt-crisper.txt Loading commit data...
stt-crisper.venv-transformers.txt Loading commit data...
stt-nemo.light Loading commit data...
stt-nemo.txt Loading commit data...
stt-nemo.venv-nemo.txt Loading commit data...
stt.txt Loading commit data...
text.txt Loading commit data...
tts-xtts.light Loading commit data...
tts-xtts.txt Loading commit data...
tts-xtts.venv-TTS.check Loading commit data...
tts-xtts.venv-TTS.txt Loading commit data...
tts.txt Loading commit data...
video.txt Loading commit data...
voice.build-deps Loading commit data...
voice.txt Loading commit data...