-
Your Name authored
- Add offload_strategy to kwargs in _load_default_model and _load_model_by_name - Fix parameter name: ram -> manual_ram_gb to match backend expectation - Also pass load_in_4bit, load_in_8bit, and max_gpu_percent
bf1d3f52
- Add offload_strategy to kwargs in _load_default_model and _load_model_by_name - Fix parameter name: ram -> manual_ram_gb to match backend expectation - Also pass load_in_4bit, load_in_8bit, and max_gpu_percent
| Name |
Last commit
|
Last update |
|---|---|---|
| .. | ||
| api | Loading commit data... | |
| backends | Loading commit data... | |
| models | Loading commit data... | |
| pydantic | Loading commit data... | |
| queue | Loading commit data... | |
| __init__.py | Loading commit data... | |
| cli.py | Loading commit data... | |
| main.py | Loading commit data... | |
| main.py~ | Loading commit data... |