- _get_model_used_vram_gb reports a vLLM model's real footprint (gpu_memory_utilization
  x total VRAM via new _total_vram_gb), so the standard evict-before-load path frees the
  right room before starting vLLM (gmu~0.9 => effectively exclusive; low gmu co-tenants).
  Eviction OF vLLM to free room for others is already handled by normal LRU (backend
  .cleanup -> stop_service); thermal throttling is inherited via request_model/wait_until_safe.
- vllm.gpu (CUDA_VISIBLE_DEVICES) to pin the instance to specific NVIDIA GPU(s); wired in
  vllm_worker env + config + admin card + routes. vLLM is CUDA-only (capability on nvidia/
  cuda nodes); AMD would need a ROCm vLLM build.
Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW