• Stefy Lanza (nextime / spora )'s avatar
    embeddings: per-model throttle + default 200ms pacing · dc6026ef
    Stefy Lanza (nextime / spora ) authored
    The RX 580 (Polaris/Vulkan) keeps timing out its GPU ring under relentless
    back-to-back embedding load — a global throttle can't distinguish a fragile card
    from a robust one. Make the admission gate PER-MODEL: each model id gets its own
    semaphore + backlog counter + pacing, resolved from the models.json entry
    (embed_max_concurrency / embed_max_backlog / embed_min_interval_ms), falling back
    to the CODERAI_EMBED_* env vars, then defaults. Default min interval is now
    200ms (was 0) so GPU starts are paced out of the box, giving the ring breathing
    room; a robust CUDA model can set it to 0 per-model. Bump 0.1.82.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_0196Gm4PNkcuybDj9yfcz3CR
    dc6026ef
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...