Commits · 3ae78a09b386364088799c088f8add8ae9e2c584 · zhaoyu6 / sglang

"backend/apps/webui/internal/migrations/015_add_functions.py" did not exist on "0d78b638057c80f09c47599f56d91dbab40ce5d0"

06 Feb, 2024 1 commit
- Add gptq quantization model support (#141) · 3ae78a09
  Arcmoon authored Feb 07, 2024
  
  3ae78a09
30 Jan, 2024 1 commit
- Improve the control of streaming and improve the first token latency in streaming (#117) · 6f560c76
  Lianmin Zheng authored Jan 29, 2024
  
  6f560c76
25 Jan, 2024 1 commit
- Dynamic model class loading (#101) · 3a581e99
  Cody Yu authored Jan 25, 2024
  
  3a581e99
24 Jan, 2024 1 commit
- Llava-hd Support (#92) · c6576e82
  shiyi.c_98 authored Jan 24, 2024
```
Co-authored-by: Haotian Liu <liuhaotian.cn@gmail.com>
```
  c6576e82
23 Jan, 2024 2 commits
- Return logprob for choices (#87) · 9a16fea0
  Lianmin Zheng authored Jan 23, 2024
  
  9a16fea0
- Suppport qwen model and solve some problems (#75) · 63e97e5e
  Arcmoon authored Jan 23, 2024
  
  63e97e5e
21 Jan, 2024 2 commits
- Fix select and normalized logprobs (#67) · a837166e
  Lianmin Zheng authored Jan 21, 2024
  
  a837166e
- Fix select (#64) · 11f3cca6
  Lianmin Zheng authored Jan 20, 2024
  
  11f3cca6
20 Jan, 2024 1 commit
- Improve error message & Add vicuna template (#57) · f30abd09
  Lianmin Zheng authored Jan 19, 2024
  
  f30abd09
17 Jan, 2024 1 commit
- Teak mem fraction (#20) · f9d72381
  Lianmin Zheng authored Jan 17, 2024
  
  f9d72381
08 Jan, 2024 1 commit

release initial code · 22085081

Lianmin Zheng authored Jan 08, 2024


Co-authored-by: Ying Sheng <sqy1415@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>
Co-authored-by: parasol-aser <3848358+parasol-aser@users.noreply.github.com>
Co-authored-by: LiviaSun <33578456+ChuyueSun@users.noreply.github.com>
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>

22085081