tests/quantization/ggml/test_ggml.py · 2e113422b3504fe6de821bb9911b24273b11aa9c · chenpangpang / transformers

"docs/source/en/model_doc/vit.md" did not exist on "b0513b013b10939a2b47ab94933c2cca909716a2"

Fix the incorrect permutation of gguf (#31788) · ac946aac

Penut Chen authored Jul 16, 2024



* Fix the incorrect permutation of gguf

* rename num_kv_heads
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* add typing to num_kv_heads
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

* rename variables

* refactor permute function name

* update the expected text of the llama3 q4 test

---------
Co-authored-by: Marc Sun <57196510+SunMarc@users.noreply.github.com>

ac946aac

test_ggml.py 11.5 KB

Replace test_ggml.py