Skip to content

C
coderai
Switch branch/tag
Find file
BlameHistoryPermalink
  • Your Name's avatar
    Add fallback for HuggingFace tokenizer loading with progressive model name shorter variants · 3479b3f0
    Your Name authored 
    - Add uppercase quantization suffixes (_Q4_K_M, etc.) to handle cached GGUF filenames
- Add progressive fallback to try shorter model names when tokenizer loading fails
- Example: Qwen3.5-27B-Uncensored-HauhauCS-Aggressive -> try Qwen3.5-27B-Uncensored -> Qwen3.5-27B -> Qwen3.5 -> Qwen
- Add warning when all tokenizer loading attempts fail (will use manual formatting instead)
    3479b3f0
coderai 328 KB