Commits · 007eeb4eb91cb30bd6b0c2bb17a0655ea5841c15 · change / sglang

21 Jan, 2024 8 commits
- Fix the error message and dependency of openai backend (#71) · 007eeb4e
  Lianmin Zheng authored Jan 21, 2024
  
  007eeb4e
- Update README.md · e8f2b155
  Ying Sheng authored Jan 21, 2024
  
  e8f2b155
- release v0.1.7 & fix bugs · 723f0421
  Lianmin Zheng authored Jan 21, 2024
  
  723f0421
- Improve error message of openai · 585eabab
  Lianmin Zheng authored Jan 21, 2024
  
  585eabab
- Bump version to 0.1.6 (#68) · cc3ada98
  Lianmin Zheng authored Jan 21, 2024
  
  cc3ada98
- Fix select and normalized logprobs (#67) · a837166e
  Lianmin Zheng authored Jan 21, 2024
  
  a837166e
- Fix select (#64) · 11f3cca6
  Lianmin Zheng authored Jan 20, 2024
  
  11f3cca6
- Disk FSM cache and adjust code. (#63) · ca13f3b8
  Liangsheng Yin authored Jan 21, 2024
  
  ca13f3b8
20 Jan, 2024 2 commits
- Update README.md (#58) · 0b2efc2a
  Ikko Eltociear Ashimine authored Jan 20, 2024
  
  0b2efc2a
- Improve error message & Add vicuna template (#57) · f30abd09
  Lianmin Zheng authored Jan 19, 2024
  
  f30abd09
19 Jan, 2024 4 commits
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
- Format code & Improve readme (#52) · 199e82a1
  Lianmin Zheng authored Jan 18, 2024
  
  199e82a1
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
18 Jan, 2024 9 commits
- Add a llava example (#47) · 98a3e8ef
  Lianmin Zheng authored Jan 18, 2024
  
  98a3e8ef
- Increase interpreter parallelism (#46) · 2b079f89
  Lianmin Zheng authored Jan 18, 2024
  
  2b079f89
- Document sampling parameters (#45) · 05b4c398
  Lianmin Zheng authored Jan 18, 2024
  
  05b4c398
- Use HTTP link in 3rdparty module (#42) · dafafe5b
  Cody Yu authored Jan 18, 2024
  
  dafafe5b
- Add a parallel sampling case (#34) · b240f751
  Lianmin Zheng authored Jan 17, 2024
  
  b240f751
- Bump version to 0.1.5 (#33) · 501f9444
  Lianmin Zheng authored Jan 17, 2024
  
  501f9444
- Expose more arguments to control the scheduling policy (#32) · 22ec7bc2
  Lianmin Zheng authored Jan 17, 2024
  
  22ec7bc2
- Add option to return metadata in async streaming (#18) · c0454b32
  Christopher Chou authored Jan 17, 2024
  
  c0454b32
- Fix streaming (#30) · 8024fc5e
  Lianmin Zheng authored Jan 17, 2024
  
  8024fc5e
17 Jan, 2024 6 commits
- update readme · 70528762
  Lianmin Zheng authored Jan 17, 2024
  
  70528762
- Update README.md · 71d30d6d
  Ying Sheng authored Jan 17, 2024
  
  71d30d6d
- Teak mem fraction (#20) · f9d72381
  Lianmin Zheng authored Jan 17, 2024
  
  f9d72381
- Improve docs & Rename Gemini -> VertexAI (#19) · bf51ddc6
  Lianmin Zheng authored Jan 17, 2024
  
  bf51ddc6
- Gemini Backend (#9) · fd7c4792
  shiyi.c_98 authored Jan 16, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  fd7c4792
- Improve docs (#17) · c4707f1b
  Lianmin Zheng authored Jan 16, 2024
  
  c4707f1b
16 Jan, 2024 7 commits
- Fix for T4 GPUs (#16) · ffe4aaee
  Ying Sheng authored Jan 16, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  ffe4aaee
- Rename image_url to image_file (#15) · 5b27a1dc
  Christopher Chou authored Jan 16, 2024
  
  5b27a1dc
- Update docs (#12) · e71d4ab3
  Lianmin Zheng authored Jan 16, 2024
  
  e71d4ab3
- Update Readme (#11) · fbf42263
  Lianmin Zheng authored Jan 16, 2024
  
  fbf42263
- update version to 0.1.3 · 2ccd9fd8
  Lianmin Zheng authored Jan 16, 2024
  
  2ccd9fd8
- Improve Readme (#10) · 46b7ea7c
  Lianmin Zheng authored Jan 15, 2024
  
  46b7ea7c
- Update benchmark scripts (#8) · 70359bf3
  Lianmin Zheng authored Jan 15, 2024
  
  70359bf3
15 Jan, 2024 3 commits
- fix radix cache match (#7) · 01ca82d7
  Liangsheng Yin authored Jan 16, 2024
  
  01ca82d7
- Fix test cases (#6) · 4bd8233f
  Lianmin Zheng authored Jan 15, 2024
  
  4bd8233f
- Json Decode && Mutl-Turns (#4) · 08ab2a16
  Liangsheng Yin authored Jan 15, 2024
  
  08ab2a16
10 Jan, 2024 1 commit
- fix typo · f652494d
  hnyls2002 authored Jan 10, 2024
  
  f652494d