• Stefy Lanza (nextime / spora )'s avatar
    front: route gguf bare alias by capability to its real engine, not nvidia · 482e47cf
    Stefy Lanza (nextime / spora ) authored
    pick_engine honours the front's assignment (radeon) only if the engine
    can_serve the request's required capability. But _required_cap derived
    that capability from the bare alias 'coe-…-q4_k_m' — no literal 'gguf' —
    so required_capability returned 'transformers' (CUDA-only). radeon is
    gguf-only, failed can_serve, and the request fell through to the default
    engine (nvidia), even though compute_assignment had correctly placed the
    model on radeon (it sees the full '…-q4_k_m.gguf' path).
    
    Resolve the model's configured path in _load_pins (now indexed by the
    .gguf-stripped stem too) and, when the name heuristic yields
    'transformers' but that path is a .gguf, correct the capability to
    'gguf'. whisper/ds4 precedence is unchanged. Combined with the registry
    stem-matching, a bare-alias request now lands on the owning Vulkan/AMD
    engine.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    482e47cf
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...