• Stefy Lanza (nextime / spora )'s avatar
    models: stop batching first-paint reads through the engine (page was slow) · ececdf83
    Stefy Lanza (nextime / spora ) authored
    The /admin/api/batch aggregator fans every sub-path to the PRIMARY ENGINE. After
    moving cache-stats/cached-models/downloads to the coderai-system worker and
    settings to the front, batching them still sent them to the (busy) engine — so the
    models page kept loading its data from the slow engine.
    
    Those endpoints now route to fast targets (front + system worker), so the batch's
    connection-saving no longer applies and was actually the bottleneck. The models
    page now loads each first-paint read directly to its correct target: settings →
    front, cache-stats/cached-models/downloads → coderai-system, only models/
    quantize-status → engine. The main model cards come from cached-models (system
    worker), so the list paints fast even mid-generation.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m
    ececdf83
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...