• Stefy Lanza (nextime / spora )'s avatar
    ui: document ds4 performance setup in global + per-model settings · 2b2bdc72
    Stefy Lanza (nextime / spora ) authored
    Add a "tuning ds4 for performance" note to the global ds4 Settings section and a
    condensed inline note to the per-model ds4 streaming section on the Models page:
    NVMe/SSD placement (≈10× prefill), capping the expert cache by count, sizing the
    VRAM reserve, DS4_CUDA_WEIGHT_ARENA_CHUNK_MB=512, avoiding DS4_CUDA_WEIGHT_CACHE,
    and that decode of a model larger than VRAM is streaming-bound (smaller quant is
    the real fix). Distilled from measured tuning on the 154GB DeepSeek-V4 MoE.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    2b2bdc72
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...