• Stefy Lanza (nextime / spora )'s avatar
    Honor provider/rotation/autoselect context & token defaults; bump to 0.99.81 · d626dda9
    Stefy Lanza (nextime / spora ) authored
    Provider-level defaults were ignored when a provider had no per-model
    configs, so coderai/broker providers reported a fixed 4096 context window
    and clients fell back to their own defaults.
    
    - model list (handlers.py): fall back to provider_config.default_context_size
      for context_window/context_length before inferring
    - rotation/autoselect model list (routes/api.py): attach context_window/
      context_length resolved from rotation/autoselect/provider defaults (was
      absent entirely, causing clients to default to 4096)
    - handle_rotation_model_list: honor provider default_context_size before
      heuristic auto-derivation
    - max output tokens: add ProviderModelConfig.max_tokens and
      default_max_tokens on Provider/Rotation/Autoselect configs, plus
      get_max_completion_tokens_for_model resolver, applied as a fallback in
      all request paths when the client omits max_tokens
    - get_max_request_tokens_for_model: fall back to
      provider_config.default_max_request_tokens; drop duplicated dead block
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    d626dda9
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...