Commits · 9cc733b38ceb4fc9df0daa6aed7335f2f8a4ba82 · zhaoyu6 / sglang

05 Dec, 2024 1 commit
- move apply_torchao_config_ to model_runner (#2342) · 9cc733b3
  Jerry Zhang authored Dec 04, 2024
  
  9cc733b3
21 Nov, 2024 1 commit
- Error out when torchao-config option is not recognized (#2107) · 5c6a41fa
  Jerry Zhang authored Nov 20, 2024
  
  5c6a41fa
28 Sep, 2024 1 commit
- Add float8 dynamic quant to torchao_utils (#1528) · 63e845d0
  Jerry Zhang authored Sep 28, 2024
  
  63e845d0
14 Sep, 2024 1 commit
- Add torchao quant for mixtral and qwen_moe (#1418) · 30b404ce
  Jerry Zhang authored Sep 13, 2024
  
  30b404ce
10 Sep, 2024 1 commit
- [Minor] improve kill scripts and torchao import (#1375) · 6c7cb903
  Lianmin Zheng authored Sep 10, 2024
  
  6c7cb903
09 Sep, 2024 1 commit
- Add torchao quant (int4/int8/fp8) to llama models (#1341) · a7c47e0f
  Jerry Zhang authored Sep 09, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  a7c47e0f