Add fallback to try known chat template names when tokenizer loading fails
When HF tokenizer loading fails, try known template names based on model name: - Qwen models: try qwen3, qwen templates - Llama models: try llama3, llama templates - Phi models: try phi template - Mistral models: try mistral template This helps when the tokenizer can't be loaded but we know the model family.
Showing
Please
register
or
sign in
to comment