tests/models/decoder_only/language/test_gguf.py · 5fe6bf29d657518eb4251981ada9f8c4f34dbbde · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[BugFix] Fix GGUF tp>1 when vocab_size is not divisible by 64 (#12230) · 5fe6bf29
Nicolò Lucchesi authored Jan 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
5fe6bf29

test_gguf.py 4.21 KB