• Stefy Lanza (nextime / spora )'s avatar
    runpod: send local text adapters to the pod that can receive them · a746e0fe
    Stefy Lanza (nextime / spora ) authored
    A text LoRA that exists only on this machine had nowhere to go: vLLM and
    llama.cpp resolve adapters at launch and have no endpoint to upload one
    to, so the previous commit could only report and skip it.
    
    Such a model is now routed to a coderai TEXT pod — the one pod image that
    can be sent an adapter — and the transfer is arranged around the fact
    that a pod is created before anything can be sent to it:
    
      1. the pod is told the adapter's sha256 id, computed HERE, so both
         sides agree on the name before the pod exists;
      2. the bytes go to the pod's content-addressed blob store before the
         first request, once per pod (a repeat costs one existence check);
      3. the pod resolves sha256:<hex> back to a file — text_loras.local_path
         now understands the content-addressed forms — and applies it.
    
    A published adapter still goes to vLLM, which fetches it itself: cheaper
    and faster, so publishing an adapter you use often remains the better
    path, and the log says so. A PEFT adapter DIRECTORY is still refused with
    a reason — the blob store holds single files.
    
    packaging/runpod/profiles/text.txt adds the text profile (transformers,
    peft, bitsandbytes for QLoRA bases). It has to be built and pushed before
    use; the other nine are published already.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    a746e0fe
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-crisperwhisper.txt Loading commit data...
requirements-h3.txt Loading commit data...
requirements-melotts.txt Loading commit data...
requirements-nemo.txt Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-ocr-paddle.txt Loading commit data...
requirements-ocr.txt Loading commit data...
requirements-pyannote.txt Loading commit data...
requirements-surya.txt Loading commit data...
requirements-vllm.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...