• Stefy Lanza (nextime / spora )'s avatar
    dinov2.cpp GGUF backend on Vulkan + Tasks-page compute-device badges · 1ca4a83b
    Stefy Lanza (nextime / spora ) authored
    dinov2: packaging/dinov2cpp/ builds dinov2.cpp with ggml's Vulkan
    backend plus a coderai `embed` stdin/stdout server (HF-matching
    preprocessing: short-side 256 bicubic, center-crop 224; CLS read via
    ggml_backend_tensor_get so GPU backends work; DINOV2_FORCE_CPU escape
    hatch). embeddings.py 'dinov2cpp' backend drives one persistent
    subprocess per model (evict = terminate, reload = respawn); dinov2
    GGUF entries route there. Verified on the RX 580: cos 0.9973 vs the
    HF dinov2-large backend.
    
    Tasks page: every task now shows the compute device it runs on and
    whether the model is CPU-offloading. record_vram_delta records
    per-model device+offload ("GPU RTX 3090 · CPU offload 12.4 GB");
    api_tasks tags each task from that map (engine default as fallback);
    tasks.html renders a green/amber/gray badge (GPU / offload / CPU).
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    Claude-Session: https://claude.ai/code/session_014S8VtAvG499SsCbeESRK7V
    1ca4a83b
Name
Last commit
Last update
..
cache Loading commit data...
__init__.py Loading commit data...
acceleration.py Loading commit data...
capabilities.py Loading commit data...
gpu_lock.py Loading commit data...
gpu_query.py Loading commit data...
grammar.py Loading commit data...
hf_loading.py Loading commit data...
manager.py Loading commit data...
parser.py Loading commit data...
peft_compat.py Loading commit data...
pipeline_cache.py Loading commit data...
quant.py Loading commit data...
ram_monitor.py Loading commit data...
templates.py Loading commit data...
thermal.py Loading commit data...
tmp_janitor.py Loading commit data...
tool_call_grammar.gbnf Loading commit data...
turboquant.py Loading commit data...
utils.py Loading commit data...