• Stefy Lanza (nextime / spora )'s avatar
    front: configurable compaction model + live progress to the client · 1ad76dfb
    Stefy Lanza (nextime / spora ) authored
    Auto-compaction can now summarize with a DIFFERENT model than the one
    serving the request, with a global default (config.json `compaction`) and
    a per-model override (models.json `auto_compact_model`). Empty = the
    request's own model, as before.
    
    - config: new CompactionConfig (enabled/pct/strategy/model) + round-trip
    - text.py: resolve effective settings (per-model over global), resolve the
      summarizer LAZILY (only when actually over threshold, so a separate model
      isn't loaded on every request); map-reduce the dropped history into chunks
      sized to the CHOSEN summarizer's own context, reducing iteratively until
      it fits; stream status + live per-chunk progress to the client as content
      deltas (queue-bridged from the summarizer's callback)
    - admin: global compaction card (settings) + per-model summarizer dropdown
      (models, shown only for the summarize strategy)
    
    Raw two-pass path is skipped (prompt is built from system + last user turn).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    1ad76dfb
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...