Commits · 768e05d08fc0de1eca07df93866890a5691cd24c · zhaoyu6 / sglang

26 Jul, 2024 1 commit

Yineng Zhang authored Jul 26, 2024


Co-authored-by: hnyls2002 <hnyls2002@gmail.com>
Co-authored-by: Ying Sheng <sqy1415@gmail.com>

768e05d0

24 Jul, 2024 1 commit
- Auto adjust new ratio (#708) · 4cd64b8e
  Liangsheng Yin authored Jul 23, 2024
  
  4cd64b8e
15 Jul, 2024 1 commit
- Simplify mem state (#623) · 5ac8b806
  Mingyi authored Jul 15, 2024
  
  5ac8b806
14 Jul, 2024 1 commit
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
13 Jul, 2024 1 commit
- Enable cuda graph by default (#612) · 66581596
  Lianmin Zheng authored Jul 13, 2024
  
  66581596
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
03 Jul, 2024 1 commit
- 2x performance improvement for large prefill & Fix workspace conflicts (#579) · 2a754e57
  Ying Sheng authored Jul 03, 2024
  
  2a754e57
13 Jun, 2024 1 commit
- Fix dependency & crash issues (#539) · 1374334d
  Ying Sheng authored Jun 12, 2024
  
  1374334d
08 Jun, 2024 1 commit
- Update version to 0.1.17 (#515) · e8a2327d
  Lianmin Zheng authored Jun 07, 2024
  
  e8a2327d
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

25 May, 2024 1 commit
- Optimize retract (#440) · f06e90c2
  Liangsheng Yin authored May 26, 2024
  
  f06e90c2
13 May, 2024 2 commits
- Handle truncation errors (#436) · 5dc55a5f
  Lianmin Zheng authored May 13, 2024
  
  5dc55a5f
- Cache optimizations (#418) · 39191c85
  Liangsheng Yin authored May 13, 2024
  
  39191c85
30 Apr, 2024 1 commit
- SamplingParams add "spaces_between_special_tokens" argument (#392) · 183df472
  ZhouXingg authored May 01, 2024
  
  183df472
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081