Commits · afd411d09f6d143cfb299d759056597a9fae3209 · change / sglang

"test/vscode:/vscode.git/clone" did not exist on "2c2b19b18ba7ee24e321d692ba84a69fa6cf532d"

01 Aug, 2024 1 commit
- Make scripts under `/test/srt` as unit tests (#875) · 72b6ea88
  Ying Sheng authored Aug 01, 2024
  
  72b6ea88
28 Jul, 2024 1 commit
- chore: add copyright for srt (#790) · dd7e8b94
  Yineng Zhang authored Jul 28, 2024
  
  dd7e8b94
26 Jul, 2024 1 commit
- fix: small bug for llama-405b fp16 (#733) · 252e0f7b
  Ying Sheng authored Jul 25, 2024
  
  252e0f7b
25 Jul, 2024 2 commits
- Fix bugs (fp8 checkpoints, triton cache manager) (#729) · 8fbba3de
  Ying Sheng authored Jul 25, 2024
  
  8fbba3de
- Fix dockerfile and triton cache manager (#720) · 04ec6ba2
  Liangsheng Yin authored Jul 25, 2024
  
  04ec6ba2
24 Jul, 2024 1 commit
- Fix multi-node deadlock (#709) · 01d66ae2
  Lianmin Zheng authored Jul 23, 2024
  
  01d66ae2
21 Jul, 2024 1 commit
- Support Deepseek MoE Model (#689) · eedc12e1
  Liangsheng Yin authored Jul 21, 2024
  
  eedc12e1
20 Jul, 2024 1 commit
- Fix kill process util (#666) · ec2150b2
  Ke Bao authored Jul 20, 2024
  
  ec2150b2
19 Jul, 2024 1 commit
- Remove cached triton launcher (#656) · e1792cca
  Lianmin Zheng authored Jul 18, 2024
  
  e1792cca
18 Jul, 2024 1 commit
- Remove the dependency of rpyc (#646) · d774acad
  Mingyi authored Jul 18, 2024
  
  d774acad
14 Jul, 2024 1 commit
- Optimize mem indices mangement (#619) · 564a898a
  Liangsheng Yin authored Jul 13, 2024
  
  564a898a
09 Jul, 2024 2 commits
- Make sglang compat with vllm 0.5.1 (#598) · b3868722
  Tommy Yang authored Jul 09, 2024
  
  b3868722
- add `LogitsMetadata` (#604) · f25b76c0
  Liangsheng Yin authored Jul 08, 2024
  
  f25b76c0
07 Jul, 2024 1 commit
- Add `--enable-p2p-check` option (#599) · 5304b4ef
  Liangsheng Yin authored Jul 06, 2024
  
  5304b4ef
05 Jul, 2024 1 commit
- Format (#593) · dc1b8bcf
  Ying Sheng authored Jul 05, 2024
  
  dc1b8bcf
04 Jul, 2024 1 commit
- fix flashinfer & http log level · 63fbef98
  Lianmin Zheng authored Jul 03, 2024
  
  63fbef98
25 Jun, 2024 1 commit
- Add sglang.bench_latency for offline benchmark (#564) · eb1ae6ae
  Lianmin Zheng authored Jun 25, 2024
  
  eb1ae6ae
18 Jun, 2024 1 commit
- Multi-node Tensor Parallelism (#550) · 09593e9b
  Ying Sheng authored Jun 17, 2024
```
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
```
  09593e9b
13 Jun, 2024 1 commit
- Higher priority for user input of max_prefill_tokens & format (#540) · fb9296f0
  Ying Sheng authored Jun 12, 2024
  
  fb9296f0
12 Jun, 2024 1 commit
- Fix Regression: Disable p2p for 4090 (#531) · 111991fe
  ZhouXingg authored Jun 12, 2024
```
Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
```
  111991fe
08 Jun, 2024 1 commit
- Crash the server when error or OOM happens (#514) · 91f93f14
  Lianmin Zheng authored Jun 07, 2024
  
  91f93f14
07 Jun, 2024 1 commit

Lianmin Zheng authored Jun 07, 2024


Co-authored-by: Qubitium <417764+Qubitium@users.noreply.github.com>
Co-authored-by: ZX <zx@lbx.dev>

bf3e271f

28 May, 2024 1 commit

Support data parallelism (static) (#480) · 0463f7fb

Ying Sheng authored May 27, 2024


Co-authored-by: Ying Sheng <ying.sheng@databricks.com>
Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: Liangsheng Yin <hnyls2002@gmail.com>
Co-authored-by: Zhiqiang Xie <xiezhq@stanford.edu>

0463f7fb

27 May, 2024 1 commit
- Improve benchmark scripts & add more models (#484) · 09de730d
  Lianmin Zheng authored May 27, 2024
  
  09de730d
24 May, 2024 1 commit
- Improve logging & add logit cap (#471) · 2cea6146
  Lianmin Zheng authored May 24, 2024
  
  2cea6146
21 May, 2024 2 commits
- port fp8 mixtral (#460) · 0fafc560
  Lianmin Zheng authored May 21, 2024
  
  0fafc560
- Abort disconnected requests (#457) · 8dbdc018
  Lianmin Zheng authored May 20, 2024
  
  8dbdc018
19 May, 2024 1 commit
- openai chat speculative execution (#250) · ec380dfd
  LiviaSun authored May 18, 2024
```
Co-authored-by: Ying Sheng <sqy1415@gmail.com>
```
  ec380dfd
17 May, 2024 1 commit
- Simplify port allocation (#447) · c05956e5
  Lianmin Zheng authored May 16, 2024
  
  c05956e5
14 May, 2024 1 commit
- Format code (#441) · 690d162d
  Liangsheng Yin authored May 14, 2024
  
  690d162d
13 May, 2024 2 commits
- support llava video (#426) · 0992d85f
  Yuanhan Zhang authored May 14, 2024
  
  0992d85f
- Improve error handling (#433) · 562b8857
  Lianmin Zheng authored May 12, 2024
  
  562b8857
12 May, 2024 2 commits
- Fix logit processor bugs (#427) · aee4f523
  Lianmin Zheng authored May 12, 2024
  
  aee4f523
- Clean up (#422) · 7023f413
  Lianmin Zheng authored May 11, 2024
  
  7023f413
11 May, 2024 1 commit
- Compat with latest VLLM 0.4.2 main + fork.number rename + Flashinfer 0.0.4 (#380) · 33b242df
  Qubitium authored May 12, 2024
```
Co-authored-by: ZX <zx@lbx.dev>
Co-authored-by: ZhouXingg <165115237+ZhouXingg@users.noreply.github.com>
```
  33b242df
23 Apr, 2024 1 commit
- Revert removing the unused imports (#385) · 150d7020
  Liangsheng Yin authored Apr 23, 2024
  
  150d7020
22 Apr, 2024 1 commit
- add `.isort.cfg` (#378) · 9acc6e35
  Liangsheng Yin authored Apr 22, 2024
  
  9acc6e35
09 Apr, 2024 1 commit
- Time cost utils (#355) · 62b3812b
  Liangsheng Yin authored Apr 09, 2024
  
  62b3812b
03 Mar, 2024 1 commit
- Fix addr reuse in check_port (#253) · dfb13ac4
  Liangsheng Yin authored Mar 03, 2024
  
  dfb13ac4
11 Feb, 2024 1 commit
- Fix the chat template for llava-v1.6-34b & format code (#177) · c51020cf
  Lianmin Zheng authored Feb 11, 2024
  
  c51020cf