Commits · 3842eba5fa305edfc2c66f82e8389d72784d5911 · change / sglang

28 Mar, 2024 1 commit
- Logprobs Refractor (#331) · 3842eba5
  Liangsheng Yin authored Mar 28, 2024
  
  3842eba5
11 Mar, 2024 3 commits
- Update version to v0.1.13 (#280) · 4aa5dd2c
  Lianmin Zheng authored Mar 11, 2024
  
  4aa5dd2c
- Organize `server_args` (#277) · 1b355479
  Liangsheng Yin authored Mar 11, 2024
  
  1b355479
- Improve gemma and documentations (#278) · faba293a
  Lianmin Zheng authored Mar 11, 2024
  
  faba293a
11 Feb, 2024 2 commits
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf
- Support extra field regex in OpenAI API (#172) · 50afed4e
  Cody Yu authored Feb 10, 2024
  
  50afed4e
09 Feb, 2024 1 commit
- import outlines (#168) · 37b42297
  Liangsheng Yin authored Feb 09, 2024
  
  37b42297
06 Feb, 2024 2 commits
- Format code & move functions (#155) · 23f05005
  Lianmin Zheng authored Feb 06, 2024
  
  23f05005
- Support decode token logprobs (#130) · a7334aee
  Cody Yu authored Feb 06, 2024
  
  a7334aee
05 Feb, 2024 1 commit
- jump-forward rename (#144) · 26f0bedc
  Liangsheng Yin authored Feb 05, 2024
  
  26f0bedc
30 Jan, 2024 3 commits
- [Feature] Adds basic support for image content in OpenAI chat routes (#113) · 1d0fbe8e
  Keith Stevens authored Jan 30, 2024
  
  1d0fbe8e
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
- Improve the control of streaming and improve the first token latency in streaming (#117) · 6f560c76
  Lianmin Zheng authored Jan 29, 2024
  
  6f560c76
25 Jan, 2024 1 commit
- support speculative execution for openai API (#48) · 23950056
  parasol-aser authored Jan 25, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  23950056
24 Jan, 2024 1 commit
- fast regex decode · 01ee0fbc
  Liangsheng Yin authored Jan 25, 2024
```
Auto-detect constant str path in regex FSM, then extend instead.
```
  01ee0fbc
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
19 Jan, 2024 3 commits
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081