• Stefy Lanza (nextime / spora )'s avatar
    Treat CoderAI broker warm-up as wait-and-retry, not a provider failure · 578eeb9d
    Stefy Lanza (nextime / spora ) authored
    CoderAI workers often run on small/edge hardware that drops its broker
    session while cooling down to avoid overheating. A missing broker session
    ("No active CoderAI broker session...") was treated as a hard error:
    record_failure() was called in both the provider handler and the rotation
    loop, so three of them in one request disabled the provider for a 300s
    cooldown — exactly when it just needed a moment to warm back up.
    
    Now this transient condition is handled gracefully:
    - coderai.py no longer records a failure when the error is a missing broker
      session (in any request path), so it never counts toward the disable
      threshold.
    - The rotation handler detects the CoderAI warm-up condition and waits
      CODERAI_WARMUP_WAIT_SECONDS (10s) before retrying the same provider, up to
      CODERAI_MAX_WARMUP_WAITS (3) times, fully transparent to the client. Only
      after that does it fail over to the next provider — still without recording
      a failure.
    
    Bump version to 0.99.76.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    578eeb9d
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...