• Your Name's avatar
    Fix litellm api_base for non-Ollama models · df7875e3
    Your Name authored
    - Add logic to set api_base to server's own URL for non-Ollama models
    - Extract host/port from request headers (X-Forwarded-For, Host header)
    - Determine protocol (http/https) based on global_args
    - Include debug output showing the determined api_base
    - This ensures litellm can properly connect to local server when using litellm backend with local models
    df7875e3
Name
Last commit
Last update
.vscode Loading commit data...
codai Loading commit data...
.gitignore Loading commit data...
LICENSE.md Loading commit data...
README.md Loading commit data...
aaa Loading commit data...
build.sh Loading commit data...
coder Loading commit data...
coderai Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
requirements.txt~ Loading commit data...