-
Your Name authored
- Enable sequential CPU offload if --offload-strategy or --offload-dir is specified - Add retry logic: on OOM, retry with attention_slicing, then with sequential_offload - Clear CUDA cache between retry attempts
096b75d2
| Name |
Last commit
|
Last update |
|---|---|---|
| .vscode | ||
| .gitignore | ||
| LICENSE.md | ||
| README.md | ||
| aaa | ||
| build.sh | ||
| coder | ||
| coderai | ||
| requirements-nvidia.txt | ||
| requirements-vulkan.txt | ||
| requirements.txt | ||
| requirements.txt~ |