• Stefy Lanza (nextime / spora )'s avatar
    Fix rotation failover: advance past unavailable providers instead of retrying one (v0.99.99) · 029c6986
    Stefy Lanza (nextime / spora ) authored
    The dispatch loop skipped a provider via is_rate_limited() (which includes the
    manual dashboard flag) but did NOT add it to tried_models, so the next retry
    re-selected the SAME highest-weight provider every time. A manually-flagged /
    rate-limited top-weight member (e.g. claude_think in rotation lisa) thus consumed
    all max_retries and returned 429, never failing over to a working member
    (kilo-stefy).
    
    - Use _provider_in_availability_cooldown() instead of is_rate_limited() so the
      manual flag (rotation-membership only) does not block dispatch, consistent with
      the scan.
    - Mark the skipped model as tried so failover actually advances to the next
      provider.
    - Guard the dispatch handler build in try/except too (same bad-cred 500 class).
    
    rotation/lisa now returns 200 via kilo-stefy instead of 429/500.
    Co-Authored-By: 's avatarClaude Opus 4.8 (1M context) <noreply@anthropic.com>
    029c6986
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...