Commits · fb9296f0ed07f4b9fd41f5bd9c670d5a607ae46a · zhaoyu6 / sglang

13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
08 Jun, 2024 1 commit
- Improve doc strings (#518) · f6dbd240
  Lianmin Zheng authored Jun 08, 2024
  
  f6dbd240
28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

19 May, 2024 1 commit
- Fix the broken `--disable-radix-cache` (#451) · 5b647543
  Liangsheng Yin authored May 19, 2024
  
  5b647543
13 May, 2024 1 commit
- Cache optimizations (#418) · 39191c85
  Liangsheng Yin authored May 13, 2024
  
  39191c85
25 Apr, 2024 1 commit
- Minor: style improvement of radix_cache and memory_pool (#395) · 19818b9c
  Liangsheng Yin authored Apr 26, 2024
  
  19818b9c
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
21 Apr, 2024 1 commit
- Reduce overhead when `fork(1)` (#375) · 1bf1cf19
  Liangsheng Yin authored Apr 21, 2024
  
  1bf1cf19
17 Apr, 2024 1 commit
- Optimize radix tree matching (#364) · e822e590
  Ke Bao authored Apr 18, 2024
  
  e822e590
26 Jan, 2024 1 commit
- Flush Cache API (#103) · 81561f8e
  Liangsheng Yin authored Jan 26, 2024
  
  81561f8e
15 Jan, 2024 1 commit
- fix radix cache match (#7) · 01ca82d7
  Liangsheng Yin authored Jan 16, 2024
  
  01ca82d7
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081