• Stefy Lanza (nextime / spora )'s avatar
    stop discarding the reason a GGUF would not load, and give every TTS backend the card's path · da335aeb
    Stefy Lanza (nextime / spora ) authored
    **Five models "won't load" and llama.cpp had said why.** The load-phase log
    callback printed only lines matching a keyword list about layers, buffers and
    devices. llama.cpp writes its diagnosis -- an unknown architecture, a missing
    tensor -- in none of those words, so it matched nothing and was dropped, while
    llama-cpp-python raised its one generic sentence: "Failed to load model from
    file: <path>". That string is all the client got, and all the log had.
    
    So every line is now kept in a 60-line ring, lines that look like a diagnosis
    are printed whether or not they mention a buffer, and the raised error carries
    llama.cpp's own words. A model this build genuinely cannot read is no longer
    indistinguishable from one that did not fit, a bad path, or a corrupt download.
    
    The retry ladder stops earlier too. It exists to answer one question -- does it
    fit? -- by moving layers to the host, and an attempt with NO layers on the GPU
    has already answered it. Three MTP/next-N checkpoints each burned six attempts
    down to n_gpu_layers=0, every one failing in a fraction of a second with the
    same message: 18 loads whose only effect was to push the reason further up the
    log. (What those three have in common is visible in their metadata --
    qwen35.nextn_predict_layers=1, blk.N.layer_output_scale.weight -- and with the
    reason no longer discarded, the next attempt will say so outright instead of
    leaving it to be inferred.)
    
    **XTTS and parler were handed an alias instead of a repo id.** _load_backend
    passed `model_path or model_name` to Kokoro and the bare `model_name` to
    everyone else, and for a card registered under an alias that name is the alias.
    Each isolated worker then failed in its own vocabulary, neither mentioning the
    cause:
    
      XTTS:   "XTTS venv could not load 'XTTS-v2': ValueError: not enough values to
              unpack (expected 4, got 1)" -- coqui splits a model name into
              type/lang/dataset/model, and the bare alias has no separator at all.
      parler: "parler-tts-mini-multilingual is not the path to a directory
              containing a file named config.json" -- the org is missing, so the
              real repo is never looked up, and the worker reports a model that IS
              cached as one to download first.
    
    Every backend that resolves a checkpoint now gets the path. The XTTS worker's
    own translation table is fixed to match on the last path segment as well, since
    it is reached by other callers too: it required a "/" before, which is precisely
    the case that does not apply.
    Co-Authored-By: 's avatarClaude Opus 5 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014T3rZozi1Ehk96NG1WesgC
    da335aeb
Name
Last commit
Last update
..
conftest.py Loading commit data...
ocr_lane_stub_worker.py Loading commit data...
test_accel_scheduler_family.py Loading commit data...
test_acestep_worker.py Loading commit data...
test_admin_auth.py Loading commit data...
test_admin_forward_auth.py Loading commit data...
test_admin_remote_ui.py Loading commit data...
test_admission_gate_derived.py Loading commit data...
test_admission_gate_warning.py Loading commit data...
test_adoption_matches_image_and_card.py Loading commit data...
test_attention_backend_mask.py Loading commit data...
test_audio_ml_backends.py Loading commit data...
test_audio_ml_endpoints.py Loading commit data...
test_audio_step_callback.py Loading commit data...
test_autoupgrade.py Loading commit data...
test_autoupgrade_force_options.py Loading commit data...
test_autoupgrade_midnight_force.py Loading commit data...
test_autoupgrade_recovers_a_down_server.py Loading commit data...
test_autoupgrade_sees_training.py Loading commit data...
test_black_image_and_precision.py Loading commit data...
test_broker_config.py Loading commit data...
test_broker_dispatch.py Loading commit data...
test_broker_protocol.py Loading commit data...
test_broker_shutdown.py Loading commit data...
test_broker_streaming.py Loading commit data...
test_burst_placement.py Loading commit data...
test_cached_pipeline_stays_on_gpu.py Loading commit data...
test_caption_fit_fonts_and_vram_zero.py Loading commit data...
test_caption_timings_and_status_polls.py Loading commit data...
test_card_defaults_reach_generation.py Loading commit data...
test_character_studio_fetch.py Loading commit data...
test_chat_passthrough.py Loading commit data...
test_chunking.py Loading commit data...
test_civitai_single_file.py Loading commit data...
test_cluster.py Loading commit data...
test_component_dir_not_cache_only.py Loading commit data...
test_component_quantization_modes.py Loading commit data...
test_compose.py Loading commit data...
test_compose_clip_audio.py Loading commit data...
test_compose_dialogue.py Loading commit data...
test_compose_job_log_and_encode_progress.py Loading commit data...
test_compose_music_generation.py Loading commit data...
test_compose_text_fit.py Loading commit data...
test_context_compaction.py Loading commit data...
test_control_plane_never_starves.py Loading commit data...
test_crisperwhisper_vram_eviction.py Loading commit data...
test_cuda_dtype_default_before_device.py Loading commit data...
test_dinov2_embed_binary_lookup.py Loading commit data...
test_distilled_model_defaults.py Loading commit data...
test_embed_long_input.py Loading commit data...
test_embedding_capability.py Loading commit data...
test_embedding_repo_file_detection.py Loading commit data...
test_embedding_routing_and_image_refusal.py Loading commit data...
test_eviction_message_names_the_cause.py Loading commit data...
test_ffmpeg_child_dies_with_parent.py Loading commit data...
test_field_report_fixes.py Loading commit data...
test_finish_reason_is_the_real_one.py Loading commit data...
test_footprint_is_measured_not_guessed.py Loading commit data...
test_foreign_venv_rebuild.py Loading commit data...
test_forward_auth_peer_trust.py Loading commit data...
test_front_api_auth.py Loading commit data...
test_front_forward_pool_ceiling.py Loading commit data...
test_front_inflight_leak.py Loading commit data...
test_front_ocr_swap_gate.py Loading commit data...
test_full_pass_regressions.py Loading commit data...
test_gguf_component_paths.py Loading commit data...
test_gguf_components_are_injected.py Loading commit data...
test_gguf_key_alias_repair.py Loading commit data...
test_gguf_missing_tensor_hint.py Loading commit data...
test_hf_cache_is_configured_not_inherited.py Loading commit data...
test_hf_cache_scan_memoised.py Loading commit data...
test_hf_cache_single_store.py Loading commit data...
test_hf_token_resolution.py Loading commit data...
test_hf_vision_chat.py Loading commit data...
test_host_ram_admission.py Loading commit data...
test_host_teardown_leak.py Loading commit data...
test_idle_unload_history_and_log_volume.py Loading commit data...
test_image_edit_endpoints_actually_run.py Loading commit data...
test_image_edit_uses_an_image_pipeline.py Loading commit data...
test_image_has_c_compiler.py Loading commit data...
test_image_proactive_eviction_scope.py Loading commit data...
test_image_response_format.py Loading commit data...
test_image_size_and_embeddings.py Loading commit data...
test_injected_components_released.py Loading commit data...
test_krea2_edit_pipeline.py Loading commit data...
test_late_added_alias.py Loading commit data...
test_ledger_out_of_band.py Loading commit data...
test_lipsync_engines.py Loading commit data...
test_lipsync_env.py Loading commit data...
test_live_hourly_counts_booting_pods.py Loading commit data...
test_longcat_avatar_layout.py Loading commit data...
test_longcat_bsa.py Loading commit data...
test_longcat_cancellable.py Loading commit data...
test_longcat_checkpoint_resolve.py Loading commit data...
test_longcat_component_quant.py Loading commit data...
test_longcat_config_ui.py Loading commit data...
test_longcat_external_training.py Loading commit data...
test_longcat_int8_load.py Loading commit data...
test_longcat_lora.py Loading commit data...
test_longcat_orchestration.py Loading commit data...
test_longcat_packaging.py Loading commit data...
test_longcat_placement.py Loading commit data...
test_longcat_progress.py Loading commit data...
test_longcat_prompt_cache.py Loading commit data...
test_longcat_quantize.py Loading commit data...
test_longcat_scale.py Loading commit data...
test_longcat_tasks.py Loading commit data...
test_longcat_variants.py Loading commit data...
test_longcat_vendored_source.py Loading commit data...
test_longcat_venv_env.py Loading commit data...
test_longcat_vram_estimate.py Loading commit data...
test_longcat_worker.py Loading commit data...
test_loop_watch.py Loading commit data...
test_loop_watch_stack_dump.py Loading commit data...
test_lru_stamp_on_raw_registry_write.py Loading commit data...
test_ltx2_audio_and_engines.py Loading commit data...
test_ltx_generated_audio_mux.py Loading commit data...
test_manual_multimodal_test_client.py Loading commit data...
test_measurement_invalidated_by_quant_change.py Loading commit data...
test_media_editing_refs_and_audio.py Loading commit data...
test_model_defaults_and_samplers.py Loading commit data...
test_model_loras_and_single_file.py Loading commit data...
test_model_scan_cache.py Loading commit data...
test_model_thinking_default.py Loading commit data...
test_models_context_window.py Loading commit data...
test_moderation_fails_closed.py Loading commit data...
test_multi_character.py Loading commit data...
test_no_blocking_calls_on_the_loop.py Loading commit data...
test_ocr_accent_repair.py Loading commit data...
test_ocr_accent_token_ids.py Loading commit data...
test_ocr_accent_visibility.py Loading commit data...
test_ocr_blank_page.py Loading commit data...
test_ocr_chandra.py Loading commit data...
test_ocr_confidence.py Loading commit data...
test_ocr_degraded_retry.py Loading commit data...
test_ocr_detector_venv.py Loading commit data...
test_ocr_dual_mode.py Loading commit data...
test_ocr_early_loop_abort.py Loading commit data...
test_ocr_engine_configs_and_layout.py Loading commit data...
test_ocr_fallback_pod_capable.py Loading commit data...
test_ocr_fanout.py Loading commit data...
test_ocr_fleet_workers.py Loading commit data...
test_ocr_language.py Loading commit data...
test_ocr_lease_leak_on_cancel.py Loading commit data...
test_ocr_lease_off_the_loop.py Loading commit data...
test_ocr_max_pages.py Loading commit data...
test_ocr_max_tokens_floor.py Loading commit data...
test_ocr_native_dpi.py Loading commit data...
test_ocr_olmocr.py Loading commit data...
test_ocr_page_image.py Loading commit data...
test_ocr_page_reads_off_the_default_pool.py Loading commit data...
test_ocr_pod_async_transport.py Loading commit data...
test_ocr_pod_env_round_trip.py Loading commit data...
test_ocr_pod_pipeline_gate.py Loading commit data...
test_ocr_pod_pipeline_policy.py Loading commit data...
test_ocr_pod_pool_width.py Loading commit data...
test_ocr_queue_full_is_429.py Loading commit data...
test_ocr_raster_pool.py Loading commit data...
test_ocr_request_budgets.py Loading commit data...
test_ocr_resident_budget.py Loading commit data...
test_ocr_resume_engines.py Loading commit data...
test_ocr_resume_shared.py Loading commit data...
test_ocr_served_model.py Loading commit data...
test_ocr_surya_confidence.py Loading commit data...
test_ocr_token_trace.py Loading commit data...
test_ocr_unreadable_and_dpi.py Loading commit data...
test_ocr_vram_share_and_fallback.py Loading commit data...
test_ocr_window_published.py Loading commit data...
test_ocr_worker_demand_rents.py Loading commit data...
test_ocr_worker_lanes.py Loading commit data...
test_offload_prefers_vram.py Loading commit data...
test_olmocr_pod_tls.py Loading commit data...
test_oom_priority.py Loading commit data...
test_parallel_requests_dont_cross.py Loading commit data...
test_parked_models_are_not_advertised.py Loading commit data...
test_parser_is_chosen_per_model.py Loading commit data...
test_per_request_progress.py Loading commit data...
test_placement_declines.py Loading commit data...
test_pod_env_booleans.py Loading commit data...
test_pod_gpu_telemetry.py Loading commit data...
test_pod_http_fleet_pool.py Loading commit data...
test_pod_http_pool.py Loading commit data...
test_pod_log_drain.py Loading commit data...
test_pod_loopback_tls.py Loading commit data...
test_pod_pool_fleet_ceiling.py Loading commit data...
test_pod_seed_model_type.py Loading commit data...
test_pod_teach_on_unknown_model.py Loading commit data...
test_pod_token_adoption_race.py Loading commit data...
test_pool_growth_adopts.py Loading commit data...
test_prequant_vram_and_empty_completion.py Loading commit data...
test_presenter_matting.py Loading commit data...
test_prompt_embeds_mask.py Loading commit data...
test_prompt_prefix_and_ocr_upload_size.py Loading commit data...
test_prompt_weighting_and_clip_skip.py Loading commit data...
test_proxy_context_window.py Loading commit data...
test_proxy_logprobs.py Loading commit data...
test_proxy_tool_calls_survive.py Loading commit data...
test_quantization_map_refines.py Loading commit data...
test_quantized_dtype_shim.py Loading commit data...
test_remote_code_allowlist.py Loading commit data...
test_remote_execution.py Loading commit data...
test_remote_gateway_gate.py Loading commit data...
test_remote_pinned_never_loads_locally.py Loading commit data...
test_resident_fit_is_learned.py Loading commit data...
test_runpod_adaptive_pod_width.py Loading commit data...
test_runpod_adopt_survivors.py Loading commit data...
test_runpod_capacity_cache.py Loading commit data...
test_runpod_card_memo.py Loading commit data...
test_runpod_client_pod_ceiling.py Loading commit data...
test_runpod_client_scale.py Loading commit data...
test_runpod_fleet_status.py Loading commit data...
test_runpod_grow_reason.py Loading commit data...
test_runpod_inflight_reclaim.py Loading commit data...
test_runpod_memory_bars.py Loading commit data...
test_runpod_mixed_fleet.py Loading commit data...
test_runpod_multi_worker.py Loading commit data...
test_runpod_no_duplicate_pods.py Loading commit data...
test_runpod_nonblocking_lease.py Loading commit data...
test_runpod_ocr_remotization.py Loading commit data...
test_runpod_per_pod_token.py Loading commit data...
test_runpod_placement.py Loading commit data...
test_runpod_pod_extra_args.py Loading commit data...
test_runpod_rate_limit_backoff.py Loading commit data...
test_runpod_reaper_grace.py Loading commit data...
test_runpod_refusal_is_not_death.py Loading commit data...
test_runpod_regional_volumes.py Loading commit data...
test_runpod_registry_heartbeat.py Loading commit data...
test_runpod_release_and_boot_cancel.py Loading commit data...
test_runpod_request_gpu_choice.py Loading commit data...
test_runpod_rest_fallback.py Loading commit data...
test_runpod_restart_orphans.py Loading commit data...
test_runpod_restart_reclaim.py Loading commit data...
test_runpod_scale_down.py Loading commit data...
test_runpod_scale_out.py Loading commit data...
test_runpod_schedule_region_spend.py Loading commit data...
test_runpod_status_never_hangs.py Loading commit data...
test_runpod_transient_api.py Loading commit data...
test_runpod_warm_floor_parallel.py Loading commit data...
test_runpod_warm_floor_rerent.py Loading commit data...
test_runpod_warm_floor_respects_max_pods.py Loading commit data...
test_runpod_warmup.py Loading commit data...
test_sequential_text_encoder.py Loading commit data...
test_serving_load.py Loading commit data...
test_shared_pool_adapter_identity.py Loading commit data...
test_sibling_config_disambiguation.py Loading commit data...
test_status_channel.py Loading commit data...
test_stream_error_is_not_silence.py Loading commit data...
test_stt_language_normalization.py Loading commit data...
test_stt_vram_headroom.py Loading commit data...
test_studio_composed_surfaces.py Loading commit data...
test_surya_item_cap.py Loading commit data...
test_surya_loop_reported.py Loading commit data...
test_surya_retry_budget.py Loading commit data...
test_surya_runpod_fixes.py Loading commit data...
test_surya_thread_boundary.py Loading commit data...
test_system_reload_endpoint.py Loading commit data...
test_task_budget_and_teardown.py Loading commit data...
test_teach_carries_the_engine.py Loading commit data...
test_text_encoder_offload_outputs.py Loading commit data...
test_text_lora_to_pod.py Loading commit data...
test_thinking_reaches_the_client.py Loading commit data...
test_thread_pool_sized_from_env.py Loading commit data...
test_thread_pool_sizing.py Loading commit data...
test_tool_call_arguments_on_the_wire.py Loading commit data...
test_township_api_key.py Loading commit data...
test_township_clip_geometry.py Loading commit data...
test_township_longcat.py Loading commit data...
test_township_page_js.py Loading commit data...
test_township_templates.py Loading commit data...
test_township_video_dataset.py Loading commit data...
test_tts_voice_listing.py Loading commit data...
test_typed_config_lookup.py Loading commit data...
test_upgrade_launcher.py Loading commit data...
test_uploads_without_output_dir.py Loading commit data...
test_video_as_b64_scope.py Loading commit data...
test_video_geometry.py Loading commit data...
test_vllm_one_engine_per_card.py Loading commit data...
test_vllm_qwen_tool_parser_choice.py Loading commit data...
test_vllm_served_names_sections.py Loading commit data...
test_vllm_share_self_tuning.py Loading commit data...
test_vllm_speed_levers_per_model.py Loading commit data...
test_vllm_tool_calling.py Loading commit data...
test_vram_releasers.py Loading commit data...
test_vram_sizing_and_leak_signal.py Loading commit data...
test_weight_stores.py Loading commit data...
test_whisper_server_id_routing.py Loading commit data...
test_whisper_server_local_models.py Loading commit data...
test_whisper_server_name_resolution.py Loading commit data...
test_worker_names_resolve.py Loading commit data...
test_xtts_bootstrap.py Loading commit data...