Commits · 0463f7fb52f06dcae2b10b7ca2a18a86ac135f96 · change / sglang

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

25 Apr, 2024 1 commit
- Minor: style improvement of radix_cache and memory_pool (#395) · 19818b9c
  Liangsheng Yin authored Apr 26, 2024
  
  19818b9c
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
16 Apr, 2024 1 commit
- Fix commandr import; format code · 65501a9c
  Lianmin Zheng authored Apr 16, 2024
  
  65501a9c
09 Apr, 2024 1 commit
- Time cost utils (#355) · 62b3812b
  Liangsheng Yin authored Apr 09, 2024
  
  62b3812b
11 Mar, 2024 3 commits
- Update version to v0.1.13 (#280) · 4aa5dd2c
  Lianmin Zheng authored Mar 11, 2024
  
  4aa5dd2c
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
30 Jan, 2024 1 commit
- Improve the control of streaming and improve the first token latency in streaming (#117) · 6f560c76
  Lianmin Zheng authored Jan 29, 2024
  
  6f560c76
19 Jan, 2024 1 commit
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081