test/srt/test_eval_accuracy_mini.py · 17536e7e3dde0518097dd4c22cea35f7db8e5d5a · change / sglang · GitLab

Find file Blame History Permalink

Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
a7c47e0f

test_eval_accuracy_mini.py 1.03 KB