• Stefy Lanza (nextime / spora )'s avatar
    oci: expose the NVIDIA GPU to Vulkan (NVIDIA_DRIVER_CAPABILITIES) for docker --nvidia · dbb0676d
    Stefy Lanza (nextime / spora ) authored
    The nvidia container runtime only injects the NVIDIA Vulkan ICD when the
    'graphics' driver capability is requested. --nvidia ran with the runtime default
    (compute,utility), so inside the container Vulkan could see only the AMD card
    (RADV) and llvmpipe — never the NVIDIA GPU. A Vulkan-only GGUF embedder
    (dinov2-embed, built with GGML_VULKAN) therefore could not run on the NVIDIA card
    at all; it was pinned to the AMD RX 580 or forced to CPU.
    
    Add `-e NVIDIA_DRIVER_CAPABILITIES=all` (honouring any caller-exported value) to
    the docker --nvidia args so the NVIDIA Vulkan ICD is injected and Vulkan
    enumerates the NVIDIA GPU. Enables running the GGUF dinov2 embedder on the 3090
    via Vulkan under the nvidia-gguf engine (device pinned via GGML_VK_VISIBLE_DEVICES
    / VK_ICD_FILENAMES; the build hardcodes ggml_backend_vk_init(0)). Takes effect on
    the next container (re)launch.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_01LoSpEthysqmseCc6Geizty
    dbb0676d
Name
Last commit
Last update
..
dist-bundle Loading commit data...
launcher Loading commit data...
30-amdgpu-dpm-high.rules Loading commit data...
Dockerfile.oci Loading commit data...
Dockerfile.oci-venv Loading commit data...
Dockerfile.update Loading commit data...
README-RUN.txt Loading commit data...
amdgpu-dpm-high.sh Loading commit data...
build_oci_image.sh Loading commit data...
make_dist_bundle.sh Loading commit data...
make_tarball_from_venv.sh Loading commit data...
nginx.conf Loading commit data...
package_oci_image.sh Loading commit data...
run_oci.sh Loading commit data...
smoke_test_oci.sh Loading commit data...
smoke_test_services.sh Loading commit data...
supervisord.conf Loading commit data...
update_oci_image.sh Loading commit data...