vllm/model_executor/models/mixtral_quant.py · 15aba081f33e6d048422df6dcdb94301d08d13e6 · OpenDAS / vllm_cscc

Zhuohan Li authored May 27, 2024


Co-authored-by: rsnm2 <rshaw@neuralmagic.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com>

1102bef2

mixtral_quant.py 15.9 KB