Fix --flash-attn CLI flag not being passed to model loading
- Add flash_attn extraction from global_args in _load_default_model() - Add flash_attn extraction from global_args in _load_model_by_name() - Now --flash-attn flag will properly enable Flash Attention 2 when loading models
Showing
Please
register
or
sign in
to comment