Commits · 98a3e8ef78f673175a6890fd0ed8f39a6bd51b07 · zhaoyu6 / sglang

"include/ck/utility/common_header.hpp" did not exist on "71d6b19d18e267bb6b8e04711bc37e241aaed55e"

18 Jan, 2024 6 commits
- Increase interpreter parallelism (#46) · 2b079f89
  Lianmin Zheng authored Jan 18, 2024
  
  2b079f89
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
- Bump version to 0.1.5 (#33) · 501f9444
  Lianmin Zheng authored Jan 17, 2024
  
  501f9444
- Expose more arguments to control the scheduling policy (#32) · 22ec7bc2
  Lianmin Zheng authored Jan 17, 2024
  
  22ec7bc2
- Add option to return metadata in async streaming (#18) · c0454b32
  Christopher Chou authored Jan 17, 2024
  
  c0454b32
- Fix streaming (#30) · 8024fc5e
  Lianmin Zheng authored Jan 17, 2024
  
  8024fc5e
17 Jan, 2024 4 commits
- Teak mem fraction (#20) · f9d72381
  Lianmin Zheng authored Jan 17, 2024
  
  f9d72381
- Improve docs & Rename Gemini -> VertexAI (#19) · bf51ddc6
  Lianmin Zheng authored Jan 17, 2024
  
  bf51ddc6
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
- Improve docs (#17) · c4707f1b
  Lianmin Zheng authored Jan 16, 2024
  
  c4707f1b
16 Jan, 2024 4 commits
- Fix for T4 GPUs (#16) · ffe4aaee
  Ying Sheng authored Jan 16, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  ffe4aaee
- Rename image_url to image_file (#15) · 5b27a1dc
  Christopher Chou authored Jan 16, 2024
  
  5b27a1dc
- update version to 0.1.3 · 2ccd9fd8
  Lianmin Zheng authored Jan 16, 2024
  
  2ccd9fd8
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
15 Jan, 2024 3 commits
- fix radix cache match (#7) · 01ca82d7
  Liangsheng Yin authored Jan 16, 2024
  
  01ca82d7
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
10 Jan, 2024 1 commit
- fix typo · f652494d
  hnyls2002 authored Jan 10, 2024
  
  f652494d
09 Jan, 2024 2 commits
- Add install with pip (#3) · 30720e73
  Lianmin Zheng authored Jan 09, 2024
  
  30720e73
- Add SRT json decode example (#2) · 331848de
  Liangsheng Yin authored Jan 10, 2024
  
  331848de
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081