• Stefy Lanza (nextime / spora )'s avatar
    embeddings 300ms default + admin GUI throttle fields; radeon crash-loop breaker · 07dd05a1
    Stefy Lanza (nextime / spora ) authored
    Embedding admission gate:
    - default min-interval 200ms -> 300ms (paces GPU starts harder)
    - expose embed_max_concurrency / embed_max_backlog / embed_min_interval_ms
      per-model in the admin model editor (embedding-gated section), round-tripped
      through /admin/api/model-configure into models.json
    
    Engine supervisor circuit breaker:
    - quarantine an engine that exits crashloop_max (5) times within
      crashloop_window (120s) instead of respawning it ~1/s forever. A GPU that has
      fallen off the bus (Polaris secondary-bus-reset bug) makes its engine die on
      every launch; the breaker takes radeon cleanly out of routing (embeddings fail
      fast) instead of hammering a dead card. Manual restart_engine() clears it.
    
    Pairs with host-side RX580 mitigations (dpm=high lock, lockup_timeout=25s,
    conc=1/300ms on the 3 vulkan embedding models, reset watchdog + thermal sampler).
    07dd05a1
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
REQUEST-geoclip-embeddings.md Loading commit data...
REQUEST-vpr-embeddings.md Loading commit data...
amdgpu-coredump-05000.bin Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...