• Stefy Lanza (nextime / spora )'s avatar
    models: test run — prove a model works where it is configured to run · e5cb9bc9
    Stefy Lanza (nextime / spora ) authored
    Placement now has many moving parts (image, weights, adapters, auth,
    budgets, staging) and most of them fail minutes into a pod boot, in a log
    nobody is watching. POST /v1/models/test runs the smallest real request
    for the model's kind and reports what happened, with a Test run button on
    every model page.
    
    It dispatches THROUGH THE FRONT, so it exercises the same routing, auth,
    pod provisioning and staging a real request would — a test that simulated
    the path would prove nothing about the path.
    
    `where` forces placement for that one request via a new x-coderai-placement
    header the gateway honours: "local" ignores any remote configuration,
    "remote" refuses to fall back to local. Without that you cannot verify a
    pod at all: the request would be served wherever the config decided, and
    a green result would mean nothing.
    
    Kinds with no cheap synthetic input — video (minutes of GPU and real
    money), faceswap, STT, OCR — report a reachability check and say plainly
    that no generation was run, instead of implying more than was proven.
    
    Also fixed test pollution I had introduced: the gateway fixture replaced
    module-level functions without restoring them, and one test assigned
    _model_entry_for unscoped. Both leaked into later tests, which passed
    alone and failed in the suite — the failure mode that teaches you to
    distrust the suite. Verified stable across repeated runs.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    e5cb9bc9
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
canary_worker.py Loading commit data...
characters.py Loading commit data...
colibri_worker.py Loading commit data...
crisperwhisper_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
diarization.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
h3_worker.py Loading commit data...
hub_compat.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
lipsync.py Loading commit data...
log.py Loading commit data...
lora_archs.py Loading commit data...
loras.py Loading commit data...
melotts_worker.py Loading commit data...
model_test.py Loading commit data...
models_transfer.py Loading commit data...
mux_remote.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
pyannote_worker.py Loading commit data...
ratelimit.py Loading commit data...
remote_gateway.py Loading commit data...
rerank.py Loading commit data...
runpod_client.py Loading commit data...
runpod_ledger.py Loading commit data...
runpod_worker.py Loading commit data...
spatial.py Loading commit data...
speaker_embeddings.py Loading commit data...
speaker_registry.py Loading commit data...
state.py Loading commit data...
stt_backends.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...