Commits · cdc8d607524a9cf663d2319ff452168d99645e39 · change / sglang

16 Jul, 2024 1 commit
- Fix flush cache (#627) · 41d1f677
  Lianmin Zheng authored Jul 15, 2024
  
  41d1f677
15 Jul, 2024 1 commit
- Improve tensor parallel performance (#625) · 6a2941f4
  Ying Sheng authored Jul 15, 2024
```
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
```
  6a2941f4
14 Jul, 2024 2 commits
- Update benchmark script (#621) · bae9541e
  Ying Sheng authored Jul 14, 2024
  
  bae9541e
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
13 Jul, 2024 3 commits
- Improve benchmark scripts (#615) · 0feca02d
  Lianmin Zheng authored Jul 13, 2024
  
  0feca02d
- Improve benchmark scripts & fix llava (#613) · 65c65776
  Lianmin Zheng authored Jul 13, 2024
  
  65c65776
- Enable cuda graph by default (#612) · 66581596
  Lianmin Zheng authored Jul 13, 2024
  
  66581596
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
27 Jun, 2024 1 commit
- Update readme (#568) · 945aa9be
  Lianmin Zheng authored Jun 27, 2024
  
  945aa9be
26 Jun, 2024 1 commit
- Increase the number of thread limitation for tp worker managers. (#567) · 2e6e62e1
  Lianmin Zheng authored Jun 26, 2024
  
  2e6e62e1
22 Jun, 2024 1 commit
- Fix latency benchmark (#557) · 92cb93f3
  Liangsheng Yin authored Jun 22, 2024
  
  92cb93f3
18 Jun, 2024 1 commit
- Multi-node Tensor Parallelism (#550) · 09593e9b
  Ying Sheng authored Jun 17, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  09593e9b
04 Jun, 2024 1 commit
- [Minor] improve code style · 3bc01ac1
  Lianmin Zheng authored Jun 03, 2024
  
  3bc01ac1
26 May, 2024 1 commit
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
13 May, 2024 1 commit
- Update readme (#434) · 455c9ccc
  Lianmin Zheng authored May 13, 2024
  
  455c9ccc
12 May, 2024 1 commit
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081