vllm/model_executor/models/mixtral_quant.py · 1a95f10ee7d2ffa538a6d210b53bf363e039feee · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[5/N] pass the whole config to model (#9983) · 1a95f10e
youkaichao authored Nov 08, 2024
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
1a95f10e

mixtral_quant.py 17.5 KB