• Your Name's avatar
    Add response_format support for JSON output · 0ce79fb9
    Your Name authored
    - Pass response_format to llama.cpp create_chat_completion
    - Supports {'type': 'json_object'} for JSON output mode
    - Applied to both streaming and non-streaming responses
    0ce79fb9
Name
Last commit
Last update
.vscode Loading commit data...
.gitignore Loading commit data...
LICENSE.md Loading commit data...
README.md Loading commit data...
aaa Loading commit data...
build.sh Loading commit data...
coder Loading commit data...
coderai Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
requirements.txt~ Loading commit data...