-
Stefy Lanza (nextime / spora ) authored
vLLM now works like the in-process engines: tag a model entry with backend:vllm and it's served by its own path, under its own name (VllmBackend uses the requested model name as --served-model-name, resolved from models.json). vllm.model_id/model_path are optional (single-model convenience only); default blank -> no synthetic /v1/models entry, no alias auto-routing, pin-only. Docs + admin card updated to reflect the model-list flow. Co-Authored-By:
Claude Opus 4.8 <noreply@anthropic.com> Claude-Session: https://claude.ai/code/session_01Mw2KQiswmD69T45fTfjKwW
7dee70a4
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| admin | ||
| api | ||
| backends | ||
| broker | ||
| frontproxy | ||
| models | ||
| ocr | ||
| openai | ||
| pydantic | ||
| queue | ||
| tasks | ||
| __init__.py | ||
| cli.py | ||
| config.py | ||
| main.py | ||
| platform_paths.py | ||
| system_app.py |