• Stefy Lanza (nextime / spora )'s avatar
    CoderAI: warm-up wait-and-retry on all paths + multi-hour request timeout · 59156998
    Stefy Lanza (nextime / spora ) authored
    Move the CoderAI broker warm-up handling into the provider so it applies on
    every request path (rotation, autoselect and direct), and only for the
    broker-session "cooling down" error:
    
    - coderai.py: handle_request now wraps the broker decision in a warm-up retry
      loop — on "No active CoderAI broker session" it waits CODERAI_WARMUP_WAIT_
      SECONDS (10s) and retries the same provider up to CODERAI_MAX_WARMUP_WAITS
      (3) times, then surfaces the error WITHOUT recording a failure. Streaming
      and native-proxy paths get the same treatment via _broker_request_with_warmup
      (lazy generators retry on first broker contact). Other errors still record a
      failure as before.
    - handlers.py: every place that could disable a provider on a caught error now
      skips record_failure() for the CoderAI warm-up condition (direct chat, direct
      streaming, rotation streaming, audio/TTS/image/embeddings, and the rotation
      retry loop), via the shared _is_coderai_warmup_error() helper. The rotation
      loop no longer sleeps itself (the provider already waited) — it just fails
      over without recording a failure.
    - Default CoderAI request timeout raised from 5 min to 3 hours
      (CODERAI_DEFAULT_REQUEST_TIMEOUT, overridable via coderai_config.request_
      timeout); the timeout is also applied to the direct OpenAI client.
    
    Bump version to 0.99.77.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    59156998
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...