• Stefy Lanza (nextime / spora )'s avatar
    front: configurable compaction model + live progress to the client · 1ad76dfb
    Stefy Lanza (nextime / spora ) authored
    Auto-compaction can now summarize with a DIFFERENT model than the one
    serving the request, with a global default (config.json `compaction`) and
    a per-model override (models.json `auto_compact_model`). Empty = the
    request's own model, as before.
    
    - config: new CompactionConfig (enabled/pct/strategy/model) + round-trip
    - text.py: resolve effective settings (per-model over global), resolve the
      summarizer LAZILY (only when actually over threshold, so a separate model
      isn't loaded on every request); map-reduce the dropped history into chunks
      sized to the CHOSEN summarizer's own context, reducing iteratively until
      it fits; stream status + live per-chunk progress to the client as content
      deltas (queue-bridged from the summarizer's callback)
    - admin: global compaction card (settings) + per-model summarizer dropdown
      (models, shown only for the summarize strategy)
    
    Raw two-pass path is skipped (prompt is built from system + last user turn).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    1ad76dfb
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...