• Stefy Lanza (nextime / spora )'s avatar
    gpu: make VRAM accounting/eviction ALWAYS multi-device, not just under split · 067a797e
    Stefy Lanza (nextime / spora ) authored
    Previously pooling was gated on gpu_split, so a 2-card same-backend engine (e.g.
    2× 3090, or 2× Radeon) still measured only one device for the fit/eviction math.
    
    Now both manager._get_free_vram_gb() and vulkan._pooled_free_vram_gb():
    - ALWAYS sum every visible CUDA device (torch honours CUDA_VISIBLE_DEVICES, so it
      is scoped to this engine's NVIDIA cards) → same-backend split is accounted for
      with no flag.
    - add AMD card(s) (amdgpu sysfs) only when cross-backend split is on OR no CUDA
      device is visible (a Radeon/Vulkan engine), so a Radeon engine counts its own
      cards and an NVIDIA engine only reaches across to Radeon when split is enabled.
    
    So: 2× NVIDIA → summed across both NVIDIAs; 2× Radeon → summed across both Radeons;
    split on → summed across all NVIDIA + Radeon.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    067a797e
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...