• Stefy Lanza (nextime / spora )'s avatar
    Manual disable is rotation-only; include media in response cache key · e6616376
    Stefy Lanza (nextime / spora ) authored
    Two independent fixes surfaced while diagnosing kilo-spora vision requests
    returning 503 and (once enabled) risking stale image answers.
    
    handlers.py: _raise_if_provider_unavailable no longer rejects a direct,
    provider-named request just because the provider is manually disabled. The
    dashboard disable toggle is meant to remove a provider from rotation/autoselect
    (those scans use is_provider_disabled_cheap) — it must not take the provider
    offline across the whole API. Direct calls still 503 on genuine unavailability
    (failure cooldown or usage-limit cooldown).
    
    cache.py: _generate_cache_key hashed only the text parts of multimodal
    messages, dropping image_url/video_url/audio_url. A caller that sends a fixed
    prompt with a varying image (e.g. the real-estate OUTDOOR/INDOOR classifier)
    collapsed every image to one cache key, so the first image's answer was served
    for all subsequent images. Fold each media reference into the message hash so
    different attachments produce different keys.
    Co-Authored-By: 's avatarClaude Opus 4.8 (1M context) <noreply@anthropic.com>
    e6616376
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...