• Your Name's avatar
    feat: Add Phase 1 and 2 improvements for Claude provider · b3f747ba
    Your Name authored
    Phase 1.2 - Automatic retry with exponential backoff:
    - Add _request_with_retry() method for non-streaming requests
    - Retries on 429 (with x-should-retry header), 529, 503 errors
    - Exponential backoff with jitter (1s, 2s, 4s max 30s)
    - Handles timeouts and HTTP errors gracefully
    
    Phase 1.3 - Streaming idle watchdog:
    - Add 90s idle timeout detection (matches vendors/claude)
    - Tracks last_event_time and raises TimeoutError on idle
    - Prevents indefinite hangs on dropped connections
    
    Phase 2.3 - Cache token tracking:
    - Add cache_stats dict to track cache hits/misses
    - Track cache_tokens_read and cache_tokens_created
    - Add get_cache_stats() method for analytics
    - Updates stats during streaming message_delta events
    
    Also includes:
    - Temperature fix (skip 0.0 when thinking beta active)
    - Rate limit config update (5s default for Claude)
    b3f747ba
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
.gitignore Loading commit data...
.providers.json.swp Loading commit data...
=0.5.0 Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
CHANGELOG.md Loading commit data...
CLAUDE_OAUTH2_DEEP_DIVE.md Loading commit data...
CLAUDE_OAUTH2_SETUP.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
PYPI.md Loading commit data...
README.md Loading commit data...
TODO.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
main.py Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
test_google.sh Loading commit data...
test_kiro_models_origin.py Loading commit data...
test_proxy.sh Loading commit data...
test_response_cache.py Loading commit data...