-
Stefy Lanza (nextime / spora ) authored
The 300s boot cap was a hard-coded constant; large models need much more time for the image pull + weight download. Both budgets are now per-model config: - boot_timeout_s (default 300) — until the pod exposes its port; a stuck machine is still dropped fast and the next candidate tried. - load_timeout_s (default 600) — until vLLM answers /v1/models; raise for big models. Parsed in RunpodModelConfig (min 30s), used by _provision_one in place of the class constants (which remain the fallback), whitelisted in api_model_configure, and exposed on the model page with hints. Co-Authored-By:
Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01R6iugoNeEgt9PkajKrFyq4
256900b7