• Stefy Lanza (nextime / spora )'s avatar
    Streaming support: anthropic + ollama, and true incremental streaming for google · 42e06a0c
    Stefy Lanza (nextime / spora ) authored
    - anthropic: previously ignored the stream flag entirely (always non-stream).
      Add _handle_streaming_request converting Anthropic SSE events into
      OpenAI-compatible chunks (text deltas, tool_use/input_json deltas, usage).
    - ollama: previously hard-coded stream=False. Add incremental streaming over
      /api/generate yielding OpenAI chunks.
    - google: was buffering the entire response before yielding. Stream chunks
      incrementally as they arrive when no tools are requested (the common case);
      keep the buffer-and-parse path only when tools are present, since the
      text-encoded tool-call detection needs the complete response.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    42e06a0c
Name
Last commit
Last update
..
app Loading commit data...
auth Loading commit data...
payments Loading commit data...
providers Loading commit data...
routes Loading commit data...
__init__.py Loading commit data...
aisbf.sh Loading commit data...
analytics.py Loading commit data...
batching.py Loading commit data...
cache.py Loading commit data...
classifier.py Loading commit data...
coderai_broker.py Loading commit data...
coderai_registry.py Loading commit data...
config.py Loading commit data...
context.py Loading commit data...
cost_extractor.py Loading commit data...
database.py Loading commit data...
email_utils.py Loading commit data...
geolocation.py Loading commit data...
handlers.py Loading commit data...
mcp.py Loading commit data...
models.py Loading commit data...
prompt_analysis.py Loading commit data...
streaming_optimization.py Loading commit data...
studio.py Loading commit data...
studio_adapters.py Loading commit data...
studio_services.py Loading commit data...
tor.py Loading commit data...
utils.py Loading commit data...