• Stefy Lanza (nextime / spora )'s avatar
    front: configurable compaction model + live progress to the client · 1ad76dfb
    Stefy Lanza (nextime / spora ) authored
    Auto-compaction can now summarize with a DIFFERENT model than the one
    serving the request, with a global default (config.json `compaction`) and
    a per-model override (models.json `auto_compact_model`). Empty = the
    request's own model, as before.
    
    - config: new CompactionConfig (enabled/pct/strategy/model) + round-trip
    - text.py: resolve effective settings (per-model over global), resolve the
      summarizer LAZILY (only when actually over threshold, so a separate model
      isn't loaded on every request); map-reduce the dropped history into chunks
      sized to the CHOSEN summarizer's own context, reducing iteratively until
      it fits; stream status + live per-chunk progress to the client as content
      deltas (queue-bridged from the summarizer's callback)
    - admin: global compaction card (settings) + per-model summarizer dropdown
      (models, shown only for the summarize strategy)
    
    Raw two-pass path is skipped (prompt is built from system + last user turn).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    1ad76dfb
Name
Last commit
Last update
..
__init__.py Loading commit data...
_film_net.py Loading commit data...
_rife_ifnet.py Loading commit data...
app.py Loading commit data...
archive.py Loading commit data...
audio_backends.py Loading commit data...
audio_clean.py Loading commit data...
audio_gen.py Loading commit data...
audio_stems.py Loading commit data...
characters.py Loading commit data...
custom_pipelines.py Loading commit data...
ds4_worker.py Loading commit data...
embeddings.py Loading commit data...
environments.py Loading commit data...
faceswap.py Loading commit data...
images.py Loading commit data...
log.py Loading commit data...
loras.py Loading commit data...
parler_worker.py Loading commit data...
pipelines.py Loading commit data...
prompt_cache.py Loading commit data...
ratelimit.py Loading commit data...
spatial.py Loading commit data...
state.py Loading commit data...
text.py Loading commit data...
transcriptions.py Loading commit data...
tts.py Loading commit data...
tts_backends.py Loading commit data...
urlutils.py Loading commit data...
video.py Loading commit data...
voice_clone.py Loading commit data...
voice_convert.py Loading commit data...