Commit 2d625c33 authored by Your Name's avatar Your Name

Fix: Pass multi_model_manager instead of current_manager for model resolution

current_manager is the individual model manager which doesn't have 'models'.
multi_model_manager has the 'models' dict with all loaded models.
parent 4a45f2f1
...@@ -2232,7 +2232,8 @@ async def chat_completions(request: ChatCompletionRequest, http_request: Request ...@@ -2232,7 +2232,8 @@ async def chat_completions(request: ChatCompletionRequest, http_request: Request
print(f"RAW: template_manager.format_for_raw_completion not available") print(f"RAW: template_manager.format_for_raw_completion not available")
# Get resolved model name for response (with coderai/ prefix and proper formatting) # Get resolved model name for response (with coderai/ prefix and proper formatting)
response_model_name = get_resolved_model_name(requested_model, current_manager) # Use multi_model_manager to get the actual loaded models, not the individual model manager
response_model_name = get_resolved_model_name(requested_model, multi_model_manager)
print(f"DEBUG: Requested model: {requested_model}, Resolved model for response: {response_model_name}") print(f"DEBUG: Requested model: {requested_model}, Resolved model for response: {response_model_name}")
# Handle raw mode - two pass: first capture reasoning, then get final answer # Handle raw mode - two pass: first capture reasoning, then get final answer
......
Markdown is supported
0% or
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment