• Stefy Lanza (nextime / spora )'s avatar
    vulkan: fold system role by template signal, not just architecture · 64eb74b7
    Stefy Lanza (nextime / spora ) authored
    Whether a model rejects the 'system' role is a property of the chat
    template baked into the specific GGUF, not the architecture: the gemma-2
    template and the official gemma template raise "System role not
    supported", while 'heretic' gemma4 quant conversions ship a permissive
    template that accepts system. Detect from the embedded
    tokenizer.chat_template (raise_exception/"system role") and fold only
    when it actually rejects system; fall back to architecture (Gemma) when
    no template is readable. Avoids needlessly folding permissive Gemma
    models while still covering gemma-2-9b and strict non-Gemma templates.
    The runtime "System role not supported" retry remains as a safety net.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    64eb74b7
Name
Last commit
Last update
codai Loading commit data...
docs Loading commit data...
packaging Loading commit data...
samples Loading commit data...
tests Loading commit data...
tools Loading commit data...
.dockerignore Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
CODERAI_API_DOCUMENTATION.md Loading commit data...
CoderAI.gif Loading commit data...
DISTRIBUTION.md Loading commit data...
LICENSE.md Loading commit data...
MULTIMODAL_CAPABILITIES.md Loading commit data...
MULTIMODAL_UI_EXAMPLES.md Loading commit data...
README.md Loading commit data...
build-oci.sh Loading commit data...
build.ps1 Loading commit data...
build.sh Loading commit data...
coderai Loading commit data...
coderai-broker-implementation-reference.md Loading commit data...
coderai-integration.md Loading commit data...
commands Loading commit data...
osxbuild.sh Loading commit data...
package-oci.sh Loading commit data...
package-tarball.sh Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
run-oci.sh Loading commit data...
smoke-test-oci.sh Loading commit data...
todo.md Loading commit data...
video_editor.config.json Loading commit data...