• Your Name's avatar
    Fix litellm api_base for non-Ollama models · df7875e3
    Your Name authored
    - Add logic to set api_base to server's own URL for non-Ollama models
    - Extract host/port from request headers (X-Forwarded-For, Host header)
    - Determine protocol (http/https) based on global_args
    - Include debug output showing the determined api_base
    - This ensures litellm can properly connect to local server when using litellm backend with local models
    df7875e3
coderai 360 KB