• Stefy Lanza (nextime / spora )'s avatar
    Add support for tools and tool_choice with retry on tool call errors · e4148fcf
    Stefy Lanza (nextime / spora ) authored
    - Add tools and tool_choice fields to ChatCompletionRequest model
    - Update OpenAIProviderHandler to accept and pass tools/tool_choice parameters
    - Update handlers to pass tools/tool_choice from request to provider
    - Treat tool call errors during streaming as provider failures
    - Record failure and re-raise to trigger retry with next model in rotation
    - Allows proper tool/function calling support through the proxy
    - Resolves 'Tool choice is none, but model called a tool' error by retrying with another model
    e4148fcf
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
.gitignore Loading commit data...
.providers.json.swp Loading commit data...
AI.PROMPT Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
PYPI.md Loading commit data...
README.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
main.py Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...