-
Stefy Lanza (nextime / spora ) authored
For a coderai instance that only orchestrates RunPod (no local models), the node that hosts the proxy must advertise the runpod capability. The no-GPU path already builds its engine with backend "auto" (which has it), but an explicit engine_specs backend:"cpu" and the unknown-backend fallback did not — those would 503. - _DEFAULT_CAPS gains "cpu": {transformers, gguf, k3, runpod}. - Unknown-backend fallback now {transformers, gguf, runpod} (runpod needs no local hardware, so every node can host it). Verified by simulating pick_engine for a runpod-pinned model on auto/cpu/nvidia nodes — all route instead of 503. Co-Authored-By:Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01R6iugoNeEgt9PkajKrFyq4
97d16a0a
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| admin | ||
| api | ||
| backends | ||
| broker | ||
| frontproxy | ||
| models | ||
| ocr | ||
| openai | ||
| pydantic | ||
| queue | ||
| tasks | ||
| __init__.py | ||
| cli.py | ||
| config.py | ||
| main.py | ||
| platform_paths.py | ||
| system_app.py |