• Stefy Lanza (nextime / spora )'s avatar
    Implement streaming support for Google GenAI provider · 8360e33b
    Stefy Lanza (nextime / spora ) authored
    - Use generate_content_stream() for streaming requests
    - Create async generator that yields OpenAI-compatible chunks
    - Extract text from each stream chunk
    - Generate unique chunk IDs
    - Format chunks as chat.completion.chunk objects
    - Include delta content in each chunk
    - Maintain non-streaming functionality for regular requests
    
    This fixes the streaming issue where Google GenAI was returning
    a dict instead of an iterable, causing 'JSONResponse object is
    not iterable' errors.
    8360e33b
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
.gitignore Loading commit data...
.providers.json.swp Loading commit data...
AI.PROMPT Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
PYPI.md Loading commit data...
README.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
main.py Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
test_proxy.sh Loading commit data...