• Stefy Lanza (nextime / spora )'s avatar
    stop discarding the reason a GGUF would not load, and give every TTS backend the card's path · da335aeb
    Stefy Lanza (nextime / spora ) authored
    **Five models "won't load" and llama.cpp had said why.** The load-phase log
    callback printed only lines matching a keyword list about layers, buffers and
    devices. llama.cpp writes its diagnosis -- an unknown architecture, a missing
    tensor -- in none of those words, so it matched nothing and was dropped, while
    llama-cpp-python raised its one generic sentence: "Failed to load model from
    file: <path>". That string is all the client got, and all the log had.
    
    So every line is now kept in a 60-line ring, lines that look like a diagnosis
    are printed whether or not they mention a buffer, and the raised error carries
    llama.cpp's own words. A model this build genuinely cannot read is no longer
    indistinguishable from one that did not fit, a bad path, or a corrupt download.
    
    The retry ladder stops earlier too. It exists to answer one question -- does it
    fit? -- by moving layers to the host, and an attempt with NO layers on the GPU
    has already answered it. Three MTP/next-N checkpoints each burned six attempts
    down to n_gpu_layers=0, every one failing in a fraction of a second with the
    same message: 18 loads whose only effect was to push the reason further up the
    log. (What those three have in common is visible in their metadata --
    qwen35.nextn_predict_layers=1, blk.N.layer_output_scale.weight -- and with the
    reason no longer discarded, the next attempt will say so outright instead of
    leaving it to be inferred.)
    
    **XTTS and parler were handed an alias instead of a repo id.** _load_backend
    passed `model_path or model_name` to Kokoro and the bare `model_name` to
    everyone else, and for a card registered under an alias that name is the alias.
    Each isolated worker then failed in its own vocabulary, neither mentioning the
    cause:
    
      XTTS:   "XTTS venv could not load 'XTTS-v2': ValueError: not enough values to
              unpack (expected 4, got 1)" -- coqui splits a model name into
              type/lang/dataset/model, and the bare alias has no separator at all.
      parler: "parler-tts-mini-multilingual is not the path to a directory
              containing a file named config.json" -- the org is missing, so the
              real repo is never looked up, and the worker reports a model that IS
              cached as one to download first.
    
    Every backend that resolves a checkpoint now gets the path. The XTTS worker's
    own translation table is fixed to match on the last path segment as well, since
    it is reached by other callers too: it required a "/" before, which is precisely
    the case that does not apply.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZozi1Ehk96NG1WesgC
    da335aeb
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
acestep_worker.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
audiocraft_worker.py Loading commit data...
canary_worker.py Loading commit data...
characters.py Loading commit data...
chunking.py Loading commit data...
colibri_worker.py Loading commit data...
compose.py Loading commit data...
context_overflow.py Loading commit data...
crisperwhisper_worker.py Loading commit data...
custom_pipelines.py Loading commit data...
diarization.py Loading commit data...
ds4_kv_janitor.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
fastlog.py Loading commit data...
h3_worker.py Loading commit data...
host_worker.py Loading commit data...
hub_compat.py Loading commit data...
images.py Loading commit data...
k3_worker.py Loading commit data...
kt_worker.py Loading commit data...
lang_codes.py Loading commit data...
lipsync.py Loading commit data...
lipsync_engines.py Loading commit data...
log.py Loading commit data...
longcat_worker.py Loading commit data...
loop_watch.py Loading commit data...
lora_archs.py Loading commit data...
loras.py Loading commit data...
melotts_worker.py Loading commit data...
model_test.py Loading commit data...
models_transfer.py Loading commit data...
moderation.py Loading commit data...
mux_remote.py Loading commit data...
ocr.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
pod_http.py Loading commit data...
pod_telemetry.py Loading commit data...
pod_tls.py Loading commit data...
podlog.py Loading commit data...
prompt_cache.py Loading commit data...
pyannote_worker.py Loading commit data...
ratelimit.py Loading commit data...
remote_gateway.py Loading commit data...
request_progress.py Loading commit data...
rerank.py Loading commit data...
runpod_client.py Loading commit data...
runpod_fleet_share.py Loading commit data...
runpod_ledger.py Loading commit data...
runpod_worker.py Loading commit data...
serving_load.py Loading commit data...
spatial.py Loading commit data...
speaker_embeddings.py Loading commit data...
speaker_registry.py Loading commit data...
state.py Loading commit data...
stt_backends.py Loading commit data...
text.py Loading commit data...
thread_pool.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
uploads.py Loading commit data...
urlutils.py Loading commit data...
venv_env.py Loading commit data...
video.py Loading commit data...
vllm_worker.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...
vpr_salad_server.py Loading commit data...
xtts_worker.py Loading commit data...