• Your Name's avatar
    Fix litellm api_base for non-Ollama models · df7875e3
    Your Name authored
    - Add logic to set api_base to server's own URL for non-Ollama models
    - Extract host/port from request headers (X-Forwarded-For, Host header)
    - Determine protocol (http/https) based on global_args
    - Include debug output showing the determined api_base
    - This ensures litellm can properly connect to local server when using litellm backend with local models
    df7875e3
Name
Last commit
Last update
..
models Loading commit data...
openai Loading commit data...
__init__.py Loading commit data...