• Your Name's avatar
    Add --hf-chat-template option for HuggingFace apply_chat_template · 3121fb85
    Your Name authored
    - Added --hf-chat-template CLI flag to use transformers apply_chat_template
    - Added _load_huggingface_tokenizer() to load HF tokenizer for GGUF models
    - Added _format_messages_hf() method for HF chat template formatting
    - Updated generate_chat and generate_chat_stream to use HF tokenizer when available
    - Updated format_messages to check for HF tokenizer first
    - Added documentation in README.md
    3121fb85
README.md 29.6 KB