• Stefy Lanza (nextime / spora )'s avatar
    models: stop batching first-paint reads through the engine (page was slow) · ececdf83
    Stefy Lanza (nextime / spora ) authored
    The /admin/api/batch aggregator fans every sub-path to the PRIMARY ENGINE. After
    moving cache-stats/cached-models/downloads to the coderai-system worker and
    settings to the front, batching them still sent them to the (busy) engine — so the
    models page kept loading its data from the slow engine.
    
    Those endpoints now route to fast targets (front + system worker), so the batch's
    connection-saving no longer applies and was actually the bottleneck. The models
    page now loads each first-paint read directly to its correct target: settings →
    front, cache-stats/cached-models/downloads → coderai-system, only models/
    quantize-status → engine. The main model cards come from cached-models (system
    worker), so the list paints fast even mid-generation.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m
    ececdf83
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...