Fix global_args not propagated to state module
text.py's set_global_args() was only setting its local global_args but not calling state.set_global_args(). This meant _load_default_model() and _load_model_by_name() got None from get_global_args(), so CLI flags like --flash-attn, --n-gpu-layers, --ram were not passed to backends.
Showing
Please
register
or
sign in
to comment