Commits · 2ec39ab712245e89c0897a9cc2aa257b0c577c8d · zhaoyu6 / sglang

29 Jul, 2024 1 commit
- Chunked prefill support (#797) · 2ec39ab7
  Liangsheng Yin authored Jul 29, 2024
  
  2ec39ab7
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
24 Jul, 2024 1 commit
- Update schedule_heuristic.py · 00e4baa7
  Lianmin Zheng authored Jul 24, 2024
  
  00e4baa7
21 Jul, 2024 1 commit
- support non-streaming benchmark (#682) · 77e592e8
  Lianmin Zheng authored Jul 20, 2024
  
  77e592e8
15 Jul, 2024 1 commit
- Simplify mem state (#623) · 5ac8b806
  Mingyi authored Jul 15, 2024
  
  5ac8b806
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

26 May, 2024 1 commit
- Improve benchmark scripts & rename some scripts (#477) · 55c16436
  Lianmin Zheng authored May 26, 2024
  
  55c16436
13 May, 2024 1 commit
- Cache optimizations (#418) · 39191c85
  Liangsheng Yin authored May 13, 2024
  
  39191c85
19 Jan, 2024 1 commit
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
15 Jan, 2024 1 commit
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081