Commits · 6a2941f4d037cb5fa7c927342dc7f09387c29ab0 · change / sglang

15 Jul, 2024 2 commits
- Improve tensor parallel performance (#625) · 6a2941f4
  Ying Sheng authored Jul 15, 2024
```
Co-authored-by: Mingyi <wisclmy0611@gmail.com>
```
  6a2941f4
- Simplify mem state (#623) · 5ac8b806
  Mingyi authored Jul 15, 2024
  
  5ac8b806
14 Jul, 2024 2 commits
- Update benchmark script (#621) · bae9541e
  Ying Sheng authored Jul 14, 2024
  
  bae9541e
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
13 Jul, 2024 3 commits
- Improve benchmark scripts (#615) · 0feca02d
  Lianmin Zheng authored Jul 13, 2024
  
  0feca02d
- Improve benchmark scripts & fix llava (#613) · 65c65776
  Lianmin Zheng authored Jul 13, 2024
  
  65c65776
- Enable cuda graph by default (#612) · 66581596
  Lianmin Zheng authored Jul 13, 2024
  
  66581596
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
30 Jun, 2024 1 commit
- Minor fix in compiler & format (#545) · 11616fc6
  sglang authored Jun 29, 2024
  
  11616fc6
27 Jun, 2024 1 commit
- Update readme (#568) · 945aa9be
  Lianmin Zheng authored Jun 27, 2024
  
  945aa9be
26 Jun, 2024 1 commit
- Increase the number of thread limitation for tp worker managers. (#567) · 2e6e62e1
  Lianmin Zheng authored Jun 26, 2024
  
  2e6e62e1
22 Jun, 2024 1 commit
- Fix latency benchmark (#557) · 92cb93f3
  Liangsheng Yin authored Jun 22, 2024
  
  92cb93f3
18 Jun, 2024 1 commit
- Multi-node Tensor Parallelism (#550) · 09593e9b
  Ying Sheng authored Jun 17, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  09593e9b
13 Jun, 2024 3 commits
- Add disk cache for loading ShareGPT dataset. (#542) · 40e53d65
  Liangsheng Yin authored Jun 13, 2024
  
  40e53d65
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
- Fix dependency & crash issues (#539) · 1374334d
  Ying Sheng authored Jun 12, 2024
  
  1374334d
04 Jun, 2024 1 commit
- [Minor] improve code style · 3bc01ac1
  Lianmin Zheng authored Jun 03, 2024
  
  3bc01ac1
27 May, 2024 1 commit
- Improve benchmark scripts & add more models (#484) · 09de730d
  Lianmin Zheng authored May 27, 2024
  
  09de730d
26 May, 2024 2 commits
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
- Add benchmark scripts (#476) · 947bda73
  Ying Sheng authored May 26, 2024
  
  947bda73
24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
13 May, 2024 1 commit
- Update readme (#434) · 455c9ccc
  Lianmin Zheng authored May 13, 2024
  
  455c9ccc
12 May, 2024 1 commit
- Allow `input_ids` in the input of the `/generate` endpoint (#363) · 04c0b214
  Shannon Shen authored May 12, 2024
  
  04c0b214
28 Apr, 2024 1 commit
- Format Benchmark Code (#399) · 95c4e0df
  Liangsheng Yin authored Apr 28, 2024
  
  95c4e0df
18 Jan, 2024 1 commit
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
16 Jan, 2024 1 commit
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081