• Stefy Lanza (nextime / spora )'s avatar
    longcat: say why the venv build failed (v0.2.55) · 0e33dc3c
    Stefy Lanza (nextime / spora ) authored
      training failed: Command '[…py310…, '-m', 'venv', '/AI/guffcache/longcat_venv-train']'
      returned non-zero exit status 1.
    
    An exit status is not a diagnosis. The actual reason was in the log only because
    the child's stderr happened to land there:
    
      Fatal Python error: init_fs_encoding: failed to get the Python codec of the
      filesystem encoding
      ModuleNotFoundError: No module named 'encodings'
    
    Every step of the venv build went through subprocess.run(check=True), which
    reports a number and discards what the process said. They now go through a runner
    that raises with the child's output, truncated at both ends if it is long. The
    next failure here names itself instead of needing a log archaeologist.
    
    The environment is also stripped for anything that spawns the 3.10 interpreter —
    PYTHONHOME, PYTHONPATH, VIRTUAL_ENV, PYTHONEXECUTABLE and friends — because that
    is exactly the class of variable that produces the error above, and the failure is
    fatal and silent in the parent. HF cache paths, CUDA_VISIBLE_DEVICES and
    everything else still reach the child. This covers the venv build, the pip
    installs, the service launch and the train/quantise workers; the service used
    dict(os.environ) directly before.
    
    Worth being straight about: I could NOT reproduce the failure. The same command
    from a throwaway container on the same image, same user, same mount, exits 0 and
    writes a complete venv, and the engine process has no PYTHONHOME, PYTHONPATH or
    VIRTUAL_ENV in its environment. So this is not a confirmed fix for that specific
    failure — it is the removal of the reason I cannot tell you what went wrong, plus
    hardening against the one cause the error text points at. The retry will either
    work or finally say why.
    
    12 tests.
    Co-Authored-By: 's avatarClaude Opus 5 (1M context) <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY
    0e33dc3c
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
audiocraft_worker.py Loading commit data...
canary_worker.py Loading commit data...
characters.py Loading commit data...
colibri_worker.py Loading commit data...
compose.py Loading commit data...
crisperwhisper_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
diarization.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
h3_worker.py Loading commit data...
host_worker.py Loading commit data...
hub_compat.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
lipsync.py Loading commit data...
log.py Loading commit data...
longcat_worker.py Loading commit data...
lora_archs.py Loading commit data...
loras.py Loading commit data...
melotts_worker.py Loading commit data...
model_test.py Loading commit data...
models_transfer.py Loading commit data...
mux_remote.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
pod_http.py Loading commit data...
pod_tls.py Loading commit data...
prompt_cache.py Loading commit data...
pyannote_worker.py Loading commit data...
ratelimit.py Loading commit data...
remote_gateway.py Loading commit data...
rerank.py Loading commit data...
runpod_client.py Loading commit data...
runpod_ledger.py Loading commit data...
runpod_worker.py Loading commit data...
spatial.py Loading commit data...
speaker_embeddings.py Loading commit data...
speaker_registry.py Loading commit data...
state.py Loading commit data...
stt_backends.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
uploads.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...
xtts_worker.py Loading commit data...