-
Your Name authored
- Add QueueManager class to track waiting requests - Send 'waiting for model...' frames with time counter at regular intervals - Send 'Model starting' frame when model begins processing - Add x_queue_info field to streaming response frames for queue status - Track queue position and wait time for each client
aafd41eb
| Name |
Last commit
|
Last update |
|---|---|---|
| .vscode | ||
| .gitignore | ||
| LICENSE.md | ||
| README.md | ||
| build.sh | ||
| coder | ||
| coderai | ||
| requirements-nvidia.txt | ||
| requirements-vulkan.txt | ||
| requirements.txt | ||
| requirements.txt~ |