• Stefy Lanza (nextime / spora )'s avatar
    runpod: size the container disk for the weights before renting · ec7939d2
    Stefy Lanza (nextime / spora ) authored
    The failure this prevents was observable, not hypothetical: a pod boots, pulls
    the image, starts downloading, fills its 40 GB disk and dies at load_timeout_s
    having paid for every minute. The size of a HuggingFace repo is one metadata
    call, so it is asked before the pod exists, and the disk is grown to fit —
    weights plus ~25 GB for the unpacked image and the download cache.
    
    It counts what a load will actually FETCH, not the whole repo. SDXL's repo is
    77 GB, of which a diffusers load pulls 28: the rest is the same weights again
    as Flax .msgpack, legacy .bin and ONNX exports. Sizing to the repo would have
    rented 100 GB for a 28 GB model.
    
    An explicit container_disk_gb that is already large enough is respected. And
    with a network volume attached the weights land there, not on the container
    disk, so the disk stays at its configured size — which is the point of the
    volume.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    ec7939d2
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...