• Your Name's avatar
    Implement LiteLLM integration for OpenAI-compatible /v1/chat/completions · 39f8696e
    Your Name authored
    - Add litellm to requirements.txt
    - Add --parser CLI arg (auto/litellm, default auto)
    - Create codai/litellm_backend.py module with:
      - LiteLLMBackend class for standardized responses
      - Rate limit headers (x-ratelimit-remaining-tokens, x-ratelimit-limit-tokens)
      - Qwen tool-call resilience (parse <tool> and <tool_call> tags)
      - Error handling with litellm exception mapping
    - Update chat completions endpoint to use litellm when --parser litellm
    - Update codai/__init__.py to export litellm components
    39f8696e
Name
Last commit
Last update
.vscode Loading commit data...
codai Loading commit data...
.gitignore Loading commit data...
LICENSE.md Loading commit data...
README.md Loading commit data...
aaa Loading commit data...
build.sh Loading commit data...
coder Loading commit data...
coderai Loading commit data...
requirements-nvidia.txt Loading commit data...
requirements-vulkan.txt Loading commit data...
requirements.txt Loading commit data...
requirements.txt~ Loading commit data...