python/sglang/srt/server_args.py · a7c47e0f028c2a9e67cbc99ab67692ec765d3dd0 · change / sglang · GitLab

Find file Blame History Permalink

Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
a7c47e0f

server_args.py 19 KB