• Stefy Lanza (nextime / spora )'s avatar
    oci: expose the NVIDIA GPU to Vulkan (NVIDIA_DRIVER_CAPABILITIES) for docker --nvidia · dbb0676d
    Stefy Lanza (nextime / spora ) authored
    The nvidia container runtime only injects the NVIDIA Vulkan ICD when the
    'graphics' driver capability is requested. --nvidia ran with the runtime default
    (compute,utility), so inside the container Vulkan could see only the AMD card
    (RADV) and llvmpipe — never the NVIDIA GPU. A Vulkan-only GGUF embedder
    (dinov2-embed, built with GGML_VULKAN) therefore could not run on the NVIDIA card
    at all; it was pinned to the AMD RX 580 or forced to CPU.
    
    Add `-e NVIDIA_DRIVER_CAPABILITIES=all` (honouring any caller-exported value) to
    the docker --nvidia args so the NVIDIA Vulkan ICD is injected and Vulkan
    enumerates the NVIDIA GPU. Enables running the GGUF dinov2 embedder on the 3090
    via Vulkan under the nvidia-gguf engine (device pinned via GGML_VK_VISIBLE_DEVICES
    / VK_ICD_FILENAMES; the build hardcodes ggml_backend_vk_init(0)). Takes effect on
    the next container (re)launch.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    dbb0676d
run_oci.sh 32.7 KB