Commits · 97aa9b3284566a4d84c08f7c1fee3699bf694e3d · zhaoyu6 / sglang

"convert/testdata/Mistral-7B-Instruct-v0.2.json" did not exist on "c4c84b7a0d19a3ac6b2c15cb320241bc26e0672b"

30 Jan, 2024 2 commits
- Improve docs & Add JSON decode example (#121) · 97aa9b32
  Lianmin Zheng authored Jan 30, 2024
  
  97aa9b32
- Improve the control of streaming and improve the first token latency in streaming (#117) · 6f560c76
  Lianmin Zheng authored Jan 29, 2024
  
  6f560c76
25 Jan, 2024 1 commit
- support speculative execution for openai API (#48) · 23950056
  parasol-aser authored Jan 25, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  23950056
24 Jan, 2024 1 commit
- fast regex decode · 01ee0fbc
  Liangsheng Yin authored Jan 25, 2024
```
Auto-detect constant str path in regex FSM, then extend instead.
```
  01ee0fbc
23 Jan, 2024 1 commit
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
19 Jan, 2024 3 commits
- Fix the possible bug of decode out of memory (#36) · 40ab1f01
  Liangsheng Yin authored Jan 20, 2024
  
  40ab1f01
- Support v1/chat/completions (#50) · 23471f9a
  Cody Yu authored Jan 18, 2024
  
  23471f9a
- Support stream=True in v1/completions (#49) · 61d4c939
  Cody Yu authored Jan 18, 2024
  
  61d4c939
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081