Commits · c98e84c21e4313d7d307425ca43e61753a53a9f7 · change / sglang

06 Oct, 2024 1 commit
- [Minor, Performance] Use torch.argmax for greedy sampling (#1589) · c98e84c2
  Ying Sheng authored Oct 06, 2024
  
  c98e84c2
04 Oct, 2024 1 commit
- [Fix] Fix major performance bug in certain cases (#1563) · 04b262cd
  Ying Sheng authored Oct 04, 2024
```
Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
```
  04b262cd
18 Sep, 2024 1 commit
- Fix oom issues with fp8 for llama (#1454) · 1acccb36
  Lianmin Zheng authored Sep 18, 2024
  
  1acccb36
14 Sep, 2024 1 commit
- Enable torch.compile for triton backend (#1422) · 9463bc13
  Lianmin Zheng authored Sep 14, 2024
  
  9463bc13
13 Sep, 2024 2 commits
- Balance test in CI (#1411) · ad0ff62a
  Lianmin Zheng authored Sep 12, 2024
  
  ad0ff62a
- [CI] Include triton backend and online serving benchmark into CI (#1408) · 68be2f6d
  Lianmin Zheng authored Sep 12, 2024
  
  68be2f6d