• Stefy Lanza (nextime / spora )'s avatar
    dinov2.cpp GGUF backend on Vulkan + Tasks-page compute-device badges · 1ca4a83b
    Stefy Lanza (nextime / spora ) authored
    dinov2: packaging/dinov2cpp/ builds dinov2.cpp with ggml's Vulkan
    backend plus a coderai `embed` stdin/stdout server (HF-matching
    preprocessing: short-side 256 bicubic, center-crop 224; CLS read via
    ggml_backend_tensor_get so GPU backends work; DINOV2_FORCE_CPU escape
    hatch). embeddings.py 'dinov2cpp' backend drives one persistent
    subprocess per model (evict = terminate, reload = respawn); dinov2
    GGUF entries route there. Verified on the RX 580: cos 0.9973 vs the
    HF dinov2-large backend.
    
    Tasks page: every task now shows the compute device it runs on and
    whether the model is CPU-offloading. record_vram_delta records
    per-model device+offload ("GPU RTX 3090 · CPU offload 12.4 GB");
    api_tasks tags each task from that map (engine default as fallback);
    tasks.html renders a green/amber/gray badge (GPU / offload / CPU).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014S8VtAvG499SsCbeESRK7V
    1ca4a83b
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...