Skip to content

C
coderai
Commit 8a4458a3 authored by Stefy Lanza (nextime / spora )'s avatar Stefy Lanza (nextime / spora )
Browse files
Options

Fix indentation error in generate_chat_stream function

parent a63dee34
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 2 deletions
coderai
View file @ 8a4458a3
...@@ -1085,8 +1085,7 @@ class VulkanBackend(ModelBackend): ...@@ -1085,8 +1085,7 @@ class VulkanBackend(ModelBackend):
async for chunk in self.generate_stream(prompt, max_tokens, temperature, top_p, stop): async for chunk in self.generate_stream(prompt, max_tokens, temperature, top_p, stop):
yield chunk yield chunk
else: else:
print(f"DEBUG: Stream completed with {chunk_count} chunks") print(f"DEBUG: Stream completed with {chunk_count} chunks")
def _manual_format_messages(self, messages: List[Dict]) -> str:
def _manual_format_messages(self, messages: List[Dict]) -> str: def _manual_format_messages(self, messages: List[Dict]) -> str:
"""Manual fallback for formatting messages when create_chat_completion fails.""" """Manual fallback for formatting messages when create_chat_completion fails."""
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment