• Stefy Lanza (nextime / spora )'s avatar
    audio: audiocraft in the main venv, and a setting to choose the backend · 0fba12e0
    Stefy Lanza (nextime / spora ) authored
    The isolated venv was solving a problem that was not real. audiocraft is pure
    Python: its torch==2.1.0 is a declared pin, not an ABI requirement, so --no-deps
    sidesteps it. The only genuine constraint was xformers, which it imports at
    module load — and 0.0.35 ships a py39-none wheel requiring torch>=2.10, which
    this image satisfies. I had ruled that out by grepping wheel filenames for
    cp312 and missing that abi3/py39 wheels cover 3.12.
    
    Verified in the built core image: torch 2.11.0+cu128 with xformers 0.0.35,
    MusicGen and AudioGen import, ops.memory_efficient_attention present.
    
    Cost in the main venv: 950 MB. The second venv cost 6.2 GB, because it carried a
    duplicate torch and a duplicate CUDA stack. The audio image drops from 15.8 GB
    to about 10.2 GB, which also removes the reason to split it in two.
    
    audio_backend (per model, or CODERAI_AUDIO_BACKEND for a pod) selects
    audiocraft or transformers explicitly, because they are not equivalent — melody
    conditioning and AudioGen exist only in the first. Asking for audiocraft when it
    is absent raises rather than quietly substituting something less capable. A
    model's own setting beats the environment it lands in, and the choice travels to
    a pod instead of being decided by what happens to be installed there.
    
    The isolated-venv worker stays in the tree: if audiocraft 1.3.0 turns out to
    misbehave against torch 2.11 at generation time, restoring one profile file
    brings it back.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    0fba12e0
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...