Commit 8ea5055d authored by Your Name's avatar Your Name

Fix NameError: json module not accessible in nested generator function

- Add local import of json inside raw_stream_generate() nested function
- This fixes NameError that occurred when streaming responses
parent 60d6f823
...@@ -2246,6 +2246,7 @@ async def chat_completions(request: ChatCompletionRequest, http_request: Request ...@@ -2246,6 +2246,7 @@ async def chat_completions(request: ChatCompletionRequest, http_request: Request
# For streaming, we need to handle it differently # For streaming, we need to handle it differently
# First pass: generate until reasoning close tag (stream it) # First pass: generate until reasoning close tag (stream it)
async def raw_stream_generate(): async def raw_stream_generate():
import json # Local import for nested function
thought_tag, close_tag, _ = get_reasoning_stop_tokens(model_family) thought_tag, close_tag, _ = get_reasoning_stop_tokens(model_family)
reasoning_text = "" reasoning_text = ""
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment