• Stefy Lanza (nextime / spora )'s avatar
    images: make the model matrix actually servable, splitting only where measured · 3fed6161
    Stefy Lanza (nextime / spora ) authored
    The pod images were built to satisfy imports, not to serve models. The audit
    found coqui/XTTS-v2, every whisper.cpp model, diarization, speaker ID, SALAD
    place recognition and Surya all unservable on a pod, and the OCR image shipping
    no OCR engine at all.
    
    Three of the eight 'isolated' stacks are not isolated any more. Surya, speechbrain
    and pytorch_lightning all import cleanly beside torch 2.11 — their venvs were
    decided against an older torch and never re-checked, exactly like audiocraft's
    torch==2.1.0. They go straight into the ocr, stt and embeddings profiles: place
    recognition, speaker ID and Surya now work for a few hundred MB instead of three
    new images. Surya's subprocess engine is pointed at the pod's own interpreter,
    since building a venv to hold what is already installed would only cost rental
    time.
    
    Five stacks genuinely cannot share, each verified rather than assumed:
    pyannote (torchaudio.AudioMetaData is gone in 2.11), coqui-tts (a transformers
    4.x symbol), CrisperWhisper (transformers 4.46 AND torch 2.5), NeMo (large, own
    torch) and paddle (its own CUDA runtime). Each gets an image carrying a baked
    venv, rather than 6 GB added to an image everyone pulls.
    
    The `speaker` capability no longer points at the STT image: that was the assumption that it was
    'the STT deps plus a bit', and it shipped nothing for diarization or voiceprints
    at all.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    3fed6161
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...