• Stefy Lanza (nextime / spora )'s avatar
    feat(ds4): auto-route deepseek4 GGUFs by architecture; serve the requested file · 6a153c58
    Stefy Lanza (nextime / spora ) authored
    - Route to ds4 by GGUF ARCHITECTURE (general.architecture == "deepseek4"), read
      from the file header (cached) — not by filename. Mainline deepseek/2/3/32 GGUFs
      stay on llama.cpp; the model_id alias still routes for the download case.
    - ds4-server now serves the REQUESTED GGUF: Ds4Backend resolves the model to a
      local .gguf and launches `ds4-server -m <file>` (resolve_service_key keys the
      managed service per file). No fixed-variant assumption.
    - Honour the model's per-entry n_ctx for ds4-server --ctx (over the global ctx).
    - New config.ds4 options + settings UI: ssd_streaming (--ssd-streaming, stream
      MoE experts from SSD/disk), model_path (explicit -m override), and
      auto_download (OFF by default — only serve GGUFs already present; error clearly
      instead of silently pulling tens of GB; opt in to fetch model_variant).
    - AI.PROMPT: document DeepSeek-V4 = pending upstream llama.cpp PRs (needs new ggml
      ops) → ds4 for now; and ds4 routing/offload/text-only specifics.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    6a153c58
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
characters.py Loading commit data...
custom_pipelines.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
images.py Loading commit data...
log.py Loading commit data...
loras.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
ratelimit.py Loading commit data...
spatial.py Loading commit data...
state.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...