-
Stefy Lanza (nextime / spora ) authored
A 128-pod fleet at 64 pages per pod is 8192 pages on the cards, and keeping the queue full behind them doubles that. Three constants each capped the chain below it, and the lowest one decides the fleet's speed whatever the others say: front -> engine forwarding pool _FWD_MAX 8192 -> 32768 engine -> pods async client _MAX_FLEET_POOL 16384 -> 32768 pod thread pool (sync transport) _MAX_POD 8192 -> 16384 All three are still sized from ocr.max_concurrency rather than set to their ceiling, and the pod pool is still clamped to the process's task budget, so this only stops a constant from being the binding limit. Co-Authored-By:
Claude Opus 5.5 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01KnfkxBpcZ1v6ypRFFyhrVM
86e7f7c5
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| __init__.py | ||
| admin_data.py | ||
| affinity.py | ||
| app.py | ||
| assignment.py | ||
| engine_supervisor.py | ||
| gpu_detect.py | ||
| metrics.py | ||
| registry.py | ||
| reqqueue.py | ||
| router.py | ||
| ui_pages.py |