coderai-text was transformers only, so a GGUF or a vLLM-served repo still
went to an upstream image: no TLS on the direct path, no /boot, no local
LoRAs, nothing on the Tasks page. coderai-llama compiles llama-cpp-python
with CUDA for every pod GPU on the full core; coderai-vllm is vLLM in its
own uv-resolved venv on the light core, found by the worker through
CODERAI_VLLM_VENV, with the local vLLM settings forwarded. The upstream
engines stay selectable as vllm / llamacpp.
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_0182DhR1eFNPQyGmDrpHbedY