• Isotr0py's avatar
    Add Qwen2 GGUF loading support (#31175) · e4628434
    Isotr0py authored
    * add qwen2 gguf support
    
    * Update docs
    
    * fix qwen2 tokenizer
    
    * add qwen2 gguf test
    
    * fix typo in qwen2 gguf test
    
    * format code
    
    * Remove mistral, clarify the error message
    
    * format code
    
    * add typing and update docstring
    e4628434
gguf.md 3.88 KB