• Stefy Lanza (nextime / spora )'s avatar
    gpu: performance split respects per-card VRAM cap; harden process naming · 5b4ff469
    Stefy Lanza (nextime / spora ) authored
    Problem 1 — the per-card cap was read and printed ("VRAM capped at 5.0 GB on
    amd:...") but the PERFORMANCE split branch ignored it: it pushed the whole
    overflow onto the slow card (_overflow * adj[i]/others == all of it when there's
    one other card), so a 5 GB-capped RX 580 got ~47% of the layers and filled up.
    Fix: treat each card's (capped) free VRAM as an absolute ceiling — fill the fast
    lead card first up to its cap, then each other card up to ITS cap; the GPU budget
    is bounded by sum(caps) and the remainder spills to CPU via the n_gpu_layers
    auto-offload. RX 580 @5 GB now yields tensor_split [0.805, 0.195] (was [0.527,
    0.473]). The VRAM (proportional) strategy already used the capped values.
    
    Problem 2 — process naming: extract _set_proc_title() and ALSO re-assert it right
    before the engine binds uvicorn (defensive), with CODERAI_ENGINE_BACKEND as a
    fallback name. The per-engine CODERAI_ENGINE_NAME is verified distinct, so this
    guarantees coderai-front / coderai-nvidia / coderai-radeon regardless of timing.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_011DDv7BchtZQWsnPG6Jm49m
    5b4ff469
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...