• Stefy Lanza (nextime / spora )'s avatar
    Synthesize a valid SSE stream when a dict response hits the streaming path · 5255a04e
    Stefy Lanza (nextime / spora ) authored
    The chunked-request handler always returns a complete chat.completion
    dict ("Streaming is not supported for chunked rotation requests"), but
    stream=true callers still wrap it in the SSE stream generator, which
    iterated the dict and emitted its KEYS as string chunks (data: "id",
    data: "choices", ...). Clients crashed with "'str' object has no
    attribute 'choices'". Previously masked: chunked requests died earlier
    on the null-content TypeError, so this path was unreachable.
    
    When the streaming wrapper receives a plain dict, emit one well-formed
    chat.completion.chunk instead - delta carrying content and/or tool_calls
    (with the per-entry index streaming requires), the real finish_reason,
    usage attached - followed by data: [DONE].
    Co-Authored-By: 's avatarClaude Opus 4.8 (1M context) <noreply@anthropic.com>
    5255a04e
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...