• Stefy Lanza (nextime / spora )'s avatar
    the pods carried the rasteriser and were never asked to use it (v0.4.1) · 2f2e8378
    Stefy Lanza (nextime / spora ) authored
    `runpod.image` is optional. Naming `engine: coderai-vllm-ocr` is how the
    image is chosen, and pod_plan resolves that at launch. But the OCR
    pipeline's "do these pods rasterise for themselves" gate read the RAW
    `image` field, which is empty in exactly that configuration, and concluded
    the pods could not run the pipeline.
    
    So a deployment renting A40s with the surya venv and pypdfium2 baked in ran
    the whole pipeline on a GPU-less orchestrator instead: 4 rasteriser
    processes, 8 surya workers, and ~120 documents each holding a 32-page
    bitmap window. 47 GB resident on a box with 1 GB free and its swap full.
    Nothing failed. The pods served the model, the pages came back, and the
    only symptom was memory.
    
    Two readings of one switch, applied to different inputs:
    
    * pod_image_for_entry() is now the single resolver, and pod_plan() uses it
      too, so neither side can drift from the other.
    * the gate SAYS which side of the line it landed on, once per answer, with
      the image that decided it and how to change it. Silence was the real
      cost here -- the local path is a complete, successful read, so an
      install could be configured for the pod-side pipeline, never once run
      it, and look exactly like it was working.
    
    A lookup that throws now reports itself rather than answering "no".
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01KnfkxBpcZ1v6ypRFFyhrVM
    2f2e8378
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
audiocraft_worker.py Loading commit data...
canary_worker.py Loading commit data...
characters.py Loading commit data...
chunking.py Loading commit data...
colibri_worker.py Loading commit data...
compose.py Loading commit data...
crisperwhisper_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
diarization.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
h3_worker.py Loading commit data...
host_worker.py Loading commit data...
hub_compat.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
lipsync.py Loading commit data...
log.py Loading commit data...
longcat_worker.py Loading commit data...
lora_archs.py Loading commit data...
loras.py Loading commit data...
melotts_worker.py Loading commit data...
model_test.py Loading commit data...
models_transfer.py Loading commit data...
mux_remote.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
pod_http.py Loading commit data...
pod_tls.py Loading commit data...
podlog.py Loading commit data...
prompt_cache.py Loading commit data...
pyannote_worker.py Loading commit data...
ratelimit.py Loading commit data...
remote_gateway.py Loading commit data...
rerank.py Loading commit data...
runpod_client.py Loading commit data...
runpod_ledger.py Loading commit data...
runpod_worker.py Loading commit data...
spatial.py Loading commit data...
speaker_embeddings.py Loading commit data...
speaker_registry.py Loading commit data...
state.py Loading commit data...
stt_backends.py Loading commit data...
text.py Loading commit data...
thread_pool.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
uploads.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...
xtts_worker.py Loading commit data...