Fix litellm api_base for non-Ollama models
- Add logic to set api_base to server's own URL for non-Ollama models - Extract host/port from request headers (X-Forwarded-For, Host header) - Determine protocol (http/https) based on global_args - Include debug output showing the determined api_base - This ensures litellm can properly connect to local server when using litellm backend with local models
Showing
This diff is collapsed.
Please
register
or
sign in
to comment