• Stefy Lanza (nextime / spora )'s avatar
    ui: cross-GPU split controls (global + per-model) with auto VRAM-proportional ratio · c060e6dc
    Stefy Lanza (nextime / spora ) authored
    Per-model (model config modal): the "Engine / card" selector gains an "All GPUs
    (split across every backend)" option. Choosing it sets gpu_split and reveals a
    "Weight distribution" field (tensor_split, e.g. 0.8,0.2); blank = auto. A real
    engine name still pins as before.
    
    Global (Settings): "Split models across all GPUs" checkbox + default weight
    distribution field, persisted to offload.gpu_split / offload.tensor_split and
    pushed to live global_args. Per-model "All GPUs" overrides the global default.
    
    api: settings GET/POST now expose+accept offload.gpu_split / tensor_split.
    
    backend: when gpu_split is on and no ratio is given, auto-derive tensor_split
    proportional to each device's FREE VRAM (new _per_device_free_vram_gb, llama.cpp
    device order: CUDA first, then Vulkan/AMD) — e.g. 24 GB 3090 + 8 GB RX 580 ->
    ~0.75/0.25 — so the bigger card carries more without the user computing it.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    c060e6dc
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...