1. 09 Mar, 2026 9 commits
  2. 08 Mar, 2026 27 commits
  3. 07 Mar, 2026 3 commits
  4. 05 Mar, 2026 1 commit
    • Stefy Lanza (nextime / spora )'s avatar
      Add fallback for models that don't support load_in_4bit quantization · e7e2c626
      Stefy Lanza (nextime / spora ) authored
      Modify _try_load_model() to catch TypeError when quantization arguments
      are not supported by the model class. When this happens, the method now:
      1. Warns the user about unsupported quantization
      2. Retries loading the model without quantization arguments
      3. Returns the model successfully if loading works
      
      This fixes issues with models like Qwen3.5 that don't support
      bitsandbytes quantization.
      e7e2c626