vllm/model_executor/models/mixtral.py · b02fd288b28f0bfa2d7ac8958fe0d71ec22ffc1b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Hardware][NV] Fix Modelopt model loading for k-v-scales for Llama models. (#11787) · b02fd288
Pavani Majety authored Jan 29, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
Co-authored-by: mgoin <michael@neuralmagic.com>
```
b02fd288

mixtral.py 20.2 KB