• Stefy Lanza (nextime / spora )'s avatar
    ds4: on-disk KV-cache age cleanup + HF search on Enter · ce9c2943
    Stefy Lanza (nextime / spora ) authored
    - ds4: configurable janitor that age-prunes the on-disk KV-checkpoint cache
      (--kv-disk-dir, defaulted to <offload>/ds4-kv). New Ds4Config fields
      kv_cache_cleanup_enabled / kv_cache_max_age_hours (7d) /
      kv_cache_cleanup_interval_minutes (6h); new codai/api/ds4_kv_janitor.py
      reuses the tmp_janitor sweep (newest-mtime, so active sessions are spared),
      started from main.py only when ds4 + cleanup are both on. Settings UI +
      get/save wired.
    - ds4: corrected the perf note — i-quants (IQ2/IQ3) and Q2_K load but fail
      ds4's CUDA prefill (gpu layer 0 ffn batch encode failed → empty reply);
      use K-quants Q4_K and up.
    - models: pressing Enter in the HuggingFace search field now runs the search.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    ce9c2943
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...