• Stefy Lanza (nextime / spora )'s avatar
    Notify client on rotation failover (banner/metadata/headers); bump to 0.99.71 · 0a3a1df7
    Stefy Lanza (nextime / spora ) authored
    When a rotation fails over to a different provider/model than the preferred
    (highest-weight) pick, optionally notify the client so the provider/model
    change isn't silent. Opt-in via a new notify_on_failover flag, settable
    globally (rotations.json top-level) or per-rotation, mirroring notifyerrors.
    
    On a real switch (served provider/model differs from preferred), three
    mechanisms carry the notice:
    - Visible banner: prepended to message content (non-streaming) or a leading
      delta chunk (streaming).
    - JSON metadata: an aisbf_failover object on the body / leading stream chunk.
    - HTTP headers: X-AISBF-Failover/Provider/Model/Preferred-* on the
      StreamingResponse and (for non-streaming) at the rotation route.
    
    Applied to both the normal and chunked rotation paths. The banner is injected
    after caching so cache hits don't replay a stale notice; no switch means zero
    overhead and nothing emitted; default off preserves existing behavior.
    Co-Authored-By: 's avatarClaude Opus 4.8 <noreply@anthropic.com>
    0a3a1df7
Name
Last commit
Last update
aisbf Loading commit data...
config Loading commit data...
docs Loading commit data...
static Loading commit data...
templates Loading commit data...
tests Loading commit data...
.gitignore Loading commit data...
AI.PROMPT Loading commit data...
API_EXAMPLES.md Loading commit data...
BUILD_DEPLOY.md Loading commit data...
CHANGELOG.md Loading commit data...
DEBUG_GUIDE.md Loading commit data...
DOCUMENTATION.md Loading commit data...
ENDPOINTS.md Loading commit data...
KILO_OAUTH2.md Loading commit data...
LICENSE.txt Loading commit data...
MANIFEST.in Loading commit data...
MISSING_ENDPOINTS.md Loading commit data...
PYPI.md Loading commit data...
QUICK_START_PAYMENT.md Loading commit data...
README.md Loading commit data...
RUNPOD_IMPLEMENTATION_PLAN.md Loading commit data...
SUBSCRIPTION_PRICING_FEATURE.md Loading commit data...
TODO.md Loading commit data...
TORRC_SETUP.md Loading commit data...
aisbf.sh Loading commit data...
build.sh Loading commit data...
chatgpt-api-implementation-guide.md Loading commit data...
clean.sh Loading commit data...
cli.py Loading commit data...
codex-oauth-implementation-guide.md Loading commit data...
main.py Loading commit data...
main.py.bak Loading commit data...
minio-archive-plan.md Loading commit data...
pyproject.toml Loading commit data...
requirements.txt Loading commit data...
screenshot.png Loading commit data...
setup.py Loading commit data...
start_proxy.sh Loading commit data...
verify_release.sh Loading commit data...