• Stefy Lanza (nextime / spora )'s avatar
    front: configurable compaction model + live progress to the client · 1ad76dfb
    Stefy Lanza (nextime / spora ) authored
    Auto-compaction can now summarize with a DIFFERENT model than the one
    serving the request, with a global default (config.json `compaction`) and
    a per-model override (models.json `auto_compact_model`). Empty = the
    request's own model, as before.
    
    - config: new CompactionConfig (enabled/pct/strategy/model) + round-trip
    - text.py: resolve effective settings (per-model over global), resolve the
      summarizer LAZILY (only when actually over threshold, so a separate model
      isn't loaded on every request); map-reduce the dropped history into chunks
      sized to the CHOSEN summarizer's own context, reducing iteratively until
      it fits; stream status + live per-chunk progress to the client as content
      deltas (queue-bridged from the summarizer's callback)
    - admin: global compaction card (settings) + per-model summarizer dropdown
      (models, shown only for the summarize strategy)
    
    Raw two-pass path is skipped (prompt is built from system + last user turn).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    1ad76dfb
Name
Last commit
Last update
..
archive.html Loading commit data...
base.html Loading commit data...
change_password.html Loading commit data...
chat.html Loading commit data...
dashboard.html Loading commit data...
login.html Loading commit data...
models.html Loading commit data...
settings.html Loading commit data...
tasks.html Loading commit data...
tokens.html Loading commit data...
users.html Loading commit data...