tests/models/decoder_only/language/test_gguf.py · df76e5af2635dee68bbace85da6c0257f6ee74bb · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[BugFix] Fix GGUF tp>1 when vocab_size is not divisible by 64 (#12230) · 5fe6bf29
Nicolò Lucchesi authored Jan 21, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
5fe6bf29

test_gguf.py 4.21 KB