• Stefy Lanza (nextime / spora )'s avatar
    runpod: make the capability images actually buildable, and cheap to ship · 8990bab3
    Stefy Lanza (nextime / spora ) authored
    Three fixes the first real build exposed.
    
    The import check caught what a lazy-import survey had missed: app.py
    mounts every router, and a few touch libraries at module level rather
    than lazily — soundfile (voice_convert), cv2/PIL (faceswap), litellm
    (parser), websockets (broker client). A static walk of the import graph
    from codai.api.app found the full set; they are now in core.txt with a
    note saying why. torch and transformers are NOT among them, so they stay
    per-profile.
    
    torch moved into core so it becomes ONE shared layer. Nine images each
    building their own copy would duplicate ~5 GB nine times — on disk and on
    every push. Core is now its own RUN, identical across profiles, so all
    nine share it.
    
    A BuildKit pip cache mount means building all nine downloads torch once
    rather than nine times, which matters when the link is also pulling
    models.
    
    build_all_capability_images.sh drives the set. Sequential on purpose:
    they share the cache and the core layer, so parallel builds would race on
    both. Each image must answer /healthz before the next starts.
    
    Validated: coderai-embeddings built, imported and answered /healthz
    (7259 MB) before this restructuring.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    8990bab3
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...