• Stefy Lanza (nextime / spora )'s avatar
    embeddings 300ms default + admin GUI throttle fields; radeon crash-loop breaker · 07dd05a1
    Stefy Lanza (nextime / spora ) authored
    Embedding admission gate:
    - default min-interval 200ms -> 300ms (paces GPU starts harder)
    - expose embed_max_concurrency / embed_max_backlog / embed_min_interval_ms
      per-model in the admin model editor (embedding-gated section), round-tripped
      through /admin/api/model-configure into models.json
    
    Engine supervisor circuit breaker:
    - quarantine an engine that exits crashloop_max (5) times within
      crashloop_window (120s) instead of respawning it ~1/s forever. A GPU that has
      fallen off the bus (Polaris secondary-bus-reset bug) makes its engine die on
      every launch; the breaker takes radeon cleanly out of routing (embeddings fail
      fast) instead of hammering a dead card. Manual restart_engine() clears it.
    
    Pairs with host-side RX580 mitigations (dpm=high lock, lockup_timeout=25s,
    conc=1/300ms on the 3 vulkan embedding models, reset watchdog + thermal sampler).
    07dd05a1
Name
Last commit
Last update
..
admin Loading commit data...
api Loading commit data...
backends Loading commit data...
broker Loading commit data...
frontproxy Loading commit data...
models Loading commit data...
openai Loading commit data...
pydantic Loading commit data...
queue Loading commit data...
tasks Loading commit data...
__init__.py Loading commit data...
cli.py Loading commit data...
config.py Loading commit data...
main.py Loading commit data...
platform_paths.py Loading commit data...
system_app.py Loading commit data...