• Stefy Lanza (nextime / spora )'s avatar
    runpod: send local text adapters to the pod that can receive them · a746e0fe
    Stefy Lanza (nextime / spora ) authored
    A text LoRA that exists only on this machine had nowhere to go: vLLM and
    llama.cpp resolve adapters at launch and have no endpoint to upload one
    to, so the previous commit could only report and skip it.
    
    Such a model is now routed to a coderai TEXT pod — the one pod image that
    can be sent an adapter — and the transfer is arranged around the fact
    that a pod is created before anything can be sent to it:
    
      1. the pod is told the adapter's sha256 id, computed HERE, so both
         sides agree on the name before the pod exists;
      2. the bytes go to the pod's content-addressed blob store before the
         first request, once per pod (a repeat costs one existence check);
      3. the pod resolves sha256:<hex> back to a file — text_loras.local_path
         now understands the content-addressed forms — and applies it.
    
    A published adapter still goes to vLLM, which fetches it itself: cheaper
    and faster, so publishing an adapter you use often remains the better
    path, and the log says so. A PEFT adapter DIRECTORY is still refused with
    a reason — the blob store holds single files.
    
    packaging/runpod/profiles/text.txt adds the text profile (transformers,
    peft, bitsandbytes for QLoRA bases). It has to be built and pushed before
    use; the other nine are published already.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    a746e0fe
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
canary_worker.py Loading commit data...
characters.py Loading commit data...
colibri_worker.py Loading commit data...
crisperwhisper_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
diarization.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
h3_worker.py Loading commit data...
hub_compat.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
lipsync.py Loading commit data...
log.py Loading commit data...
lora_archs.py Loading commit data...
loras.py Loading commit data...
melotts_worker.py Loading commit data...
models_transfer.py Loading commit data...
mux_remote.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
pyannote_worker.py Loading commit data...
ratelimit.py Loading commit data...
remote_gateway.py Loading commit data...
rerank.py Loading commit data...
runpod_client.py Loading commit data...
runpod_ledger.py Loading commit data...
runpod_worker.py Loading commit data...
spatial.py Loading commit data...
speaker_embeddings.py Loading commit data...
speaker_registry.py Loading commit data...
state.py Loading commit data...
stt_backends.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...