• Stefy Lanza (nextime / spora )'s avatar
    front: serve Overview status from front-native state during generation · 182aa69a
    Stefy Lanza (nextime / spora ) authored
    Overview's only call (/admin/api/status) was proxied to the engine, so during a
    generation (engine GIL-busy) it timed out and the dashboard showed nothing.
    
    The front now builds status from its OWN state — registry (loaded models, per-
    engine in-flight), config (backend, load_mode), models.json (enabled models +
    aliases) and live torch-free GPU stats (VRAM summed across cards) — with no
    engine round-trip. It's used whenever the engine can't answer, and the front
    skips the engine entirely when the primary is mid-generation (inflight > 0) so
    Overview is instant instead of waiting out the timeout. Engine-only fields
    (recent_activity, RAM watcher) are carried over from the last good status; when
    the engine is idle the richer engine status is still used.
    
    Verified: _native_status() builds a complete payload (status/backend/load_mode/
    enabled_models/vram/requests) via TestClient/standalone.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m
    182aa69a
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...