• Stefy Lanza (nextime / spora )'s avatar
    oci: expose the NVIDIA GPU to Vulkan (NVIDIA_DRIVER_CAPABILITIES) for docker --nvidia · dbb0676d
    Stefy Lanza (nextime / spora ) authored
    The nvidia container runtime only injects the NVIDIA Vulkan ICD when the
    'graphics' driver capability is requested. --nvidia ran with the runtime default
    (compute,utility), so inside the container Vulkan could see only the AMD card
    (RADV) and llvmpipe — never the NVIDIA GPU. A Vulkan-only GGUF embedder
    (dinov2-embed, built with GGML_VULKAN) therefore could not run on the NVIDIA card
    at all; it was pinned to the AMD RX 580 or forced to CPU.
    
    Add `-e NVIDIA_DRIVER_CAPABILITIES=all` (honouring any caller-exported value) to
    the docker --nvidia args so the NVIDIA Vulkan ICD is injected and Vulkan
    enumerates the NVIDIA GPU. Enables running the GGUF dinov2 embedder on the 3090
    via Vulkan under the nvidia-gguf engine (device pinned via GGML_VK_VISIBLE_DEVICES
    / VK_ICD_FILENAMES; the build hardcodes ggml_backend_vk_init(0)). Takes effect on
    the next container (re)launch.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    dbb0676d
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...