• Stefy Lanza (nextime / spora )'s avatar
    fix(ds4+config): resolve bare model ids, don't over-estimate VRAM, robust config · 8c85e16a
    Stefy Lanza (nextime / spora ) authored
    - ds4: resolve a bare/aliased model id (e.g. "Foo-ds4-Q2_K", no path/extension) to
      its configured .gguf via a config/cache-aware resolver — fixes the 503 ("no local
      deepseek4 GGUF resolved") on chat requests (only "Load now" with a full path
      worked before). Ds4Backend reuses the same resolver.
    - ds4: report a modest VRAM footprint for ds4 models (measured or ~12GB) instead of
      the 100GB+ GGUF size — ds4-server streams experts from SSD and manages its own
      memory, so the old estimate forced needless ~128GB eviction churn every request.
    - ds4: route on-disk KV checkpoints into coderai's offload directory by default
      (--kv-disk-dir <offload>/ds4-kv) unless overridden in extra_args.
    - config: tolerant load (_dc drops unknown keys) so a stale/newer config.json never
      crashes the whole load and silently resets ALL settings to defaults (the "had to
      reconfigure everything" bug). save_config + GET/POST settings carry the new ds4
      fields (model_path, auto_download, ssd_streaming).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    8c85e16a
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
characters.py Loading commit data...
custom_pipelines.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
images.py Loading commit data...
log.py Loading commit data...
loras.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
ratelimit.py Loading commit data...
spatial.py Loading commit data...
state.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...