Commits · 40ab1f01294f1c6cebcc0ed8597b76db039028bb · zhaoyu6 / sglang

"llm/llama.cpp/ggml/src/ggml-cuda/cpy.cuh" did not exist on "b0135f4b9b176eab9155b660d04c9ca2a1ec2341"

19 Jan, 2024 4 commits
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
- Format code & Improve readme (#52) · 199e82a1
  Lianmin Zheng authored Jan 18, 2024
  
  199e82a1
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
18 Jan, 2024 9 commits
- Add a llava example (#47) · 98a3e8ef
  Lianmin Zheng authored Jan 18, 2024
  
  98a3e8ef
- Increase interpreter parallelism (#46) · 2b079f89
  Lianmin Zheng authored Jan 18, 2024
  
  2b079f89
- Document sampling parameters (#45) · 05b4c398
  Lianmin Zheng authored Jan 18, 2024
  
  05b4c398
- Use HTTP link in 3rdparty module (#42) · dafafe5b
  Cody Yu authored Jan 18, 2024
  
  dafafe5b
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
- Bump version to 0.1.5 (#33) · 501f9444
  Lianmin Zheng authored Jan 17, 2024
  
  501f9444
- Expose more arguments to control the scheduling policy (#32) · 22ec7bc2
  Lianmin Zheng authored Jan 17, 2024
  
  22ec7bc2
- Add option to return metadata in async streaming (#18) · c0454b32
  Christopher Chou authored Jan 17, 2024
  
  c0454b32
- Fix streaming (#30) · 8024fc5e
  Lianmin Zheng authored Jan 17, 2024
  
  8024fc5e
17 Jan, 2024 6 commits
- update readme · 70528762
  Lianmin Zheng authored Jan 17, 2024
  
  70528762
- Update README.md · 71d30d6d
  Ying Sheng authored Jan 17, 2024
  
  71d30d6d
- Teak mem fraction (#20) · f9d72381
  Lianmin Zheng authored Jan 17, 2024
  
  f9d72381
- Improve docs & Rename Gemini -> VertexAI (#19) · bf51ddc6
  Lianmin Zheng authored Jan 17, 2024
  
  bf51ddc6
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
- Improve docs (#17) · c4707f1b
  Lianmin Zheng authored Jan 16, 2024
  
  c4707f1b
16 Jan, 2024 7 commits
- Fix for T4 GPUs (#16) · ffe4aaee
  Ying Sheng authored Jan 16, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  ffe4aaee
- Rename image_url to image_file (#15) · 5b27a1dc
  Christopher Chou authored Jan 16, 2024
  
  5b27a1dc
- Update docs (#12) · e71d4ab3
  Lianmin Zheng authored Jan 16, 2024
  
  e71d4ab3
- Update Readme (#11) · fbf42263
  Lianmin Zheng authored Jan 16, 2024
  
  fbf42263
- update version to 0.1.3 · 2ccd9fd8
  Lianmin Zheng authored Jan 16, 2024
  
  2ccd9fd8
- Improve Readme (#10) · 46b7ea7c
  Lianmin Zheng authored Jan 15, 2024
  
  46b7ea7c
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
15 Jan, 2024 3 commits
- fix radix cache match (#7) · 01ca82d7
  Liangsheng Yin authored Jan 16, 2024
  
  01ca82d7
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
10 Jan, 2024 1 commit
- fix typo · f652494d
  hnyls2002 authored Jan 10, 2024
  
  f652494d
09 Jan, 2024 2 commits
- Add install with pip (#3) · 30720e73
  Lianmin Zheng authored Jan 09, 2024
  
  30720e73
- Add SRT json decode example (#2) · 331848de
  Liangsheng Yin authored Jan 10, 2024
  
  331848de
08 Jan, 2024 3 commits

Update readme.md · 93eeb543
Lianmin Zheng authored Jan 08, 2024

93eeb543
Add flashinfer && Oultines (#1) · ead5b39f
Liangsheng Yin authored Jan 09, 2024

ead5b39f

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081

09 Oct, 2023 1 commit
- Initial commit · f6d40df0
  Ying Sheng authored Oct 09, 2023
  
  f6d40df0