Commits · 74e0ac1dbd1970dd74f74487e550bb1ef373bb9f · change / sglang

28 Mar, 2025 1 commit
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
25 Mar, 2025 1 commit
- support cu128 sgl-kernel (#4744) · 9b7cf9ee
  Yineng Zhang authored Mar 24, 2025
  
  9b7cf9ee
22 Mar, 2025 1 commit
- [Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.50.0 (#3984) · f8f9244a
  Adarsh Shirawalmath authored Mar 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  f8f9244a
18 Mar, 2025 1 commit
- [Hotfix] solve fp8 w8a8 ci test fail (#4531) · dd865bef
  Xiaoyu Zhang authored Mar 18, 2025
  
  dd865bef
17 Mar, 2025 1 commit

[Feature] Support Deepseek-VL2 (#2798) · d6d21640

萝卜菜 authored Mar 17, 2025


Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>

d6d21640

16 Mar, 2025 2 commits
- Support FlashMLA backend (#4472) · a53fe428
  lukec authored Mar 17, 2025
```
Co-authored-by: yinfan98 <1106310035@qq.com>
```
  a53fe428
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
15 Mar, 2025 1 commit
- ci: update transformers==4.48.3 (#4451) · 035ac2ab
  Mick authored Mar 16, 2025
  
  035ac2ab
14 Mar, 2025 1 commit
- use topk_softmax with sgl-kernel (#4439) · ad1ae7f7
  Yineng Zhang authored Mar 14, 2025
  
  ad1ae7f7
13 Mar, 2025 2 commits
- Update ci_install_dependency.sh to use accelerate 1.4.0 (#4392) · f141298a
  Lianmin Zheng authored Mar 13, 2025
```
Co-authored-by: wangyu <wangyu.steph@bytedance.com>
Co-authored-by: wangyu <yuwangauto@foxmail.com>
```
  f141298a
- upgrade sgl-kernel 0.0.5 (#4381) · 3623b6a7
  Yineng Zhang authored Mar 13, 2025
  
  3623b6a7
12 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.4.post3 (#4334) · ed91561f
  Yineng Zhang authored Mar 12, 2025
  
  ed91561f
11 Mar, 2025 2 commits
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485
- update sgl-kernel 0.0.4.post2 (#4291) · 4d27eb9a
  Yineng Zhang authored Mar 11, 2025
  
  4d27eb9a
10 Mar, 2025 1 commit
- Test no vllm custom allreduce (#4256) · 5a6400ee
  Lianmin Zheng authored Mar 10, 2025
  
  5a6400ee
09 Mar, 2025 2 commits
- Update bench speculative script (#4235) · f1d09a65
  Ke Bao authored Mar 10, 2025
  
  f1d09a65
- use sgl-kernel 0.0.4 (#4224) · 89ccb533
  Yineng Zhang authored Mar 08, 2025
  
  89ccb533
07 Mar, 2025 1 commit
- use same version for ci and pyproject (#4187) · 70866b6f
  Yineng Zhang authored Mar 07, 2025
  
  70866b6f
06 Mar, 2025 1 commit
- [docs] fix HF reference script command (#4148) · 19fd57bc
  Adarsh Shirawalmath authored Mar 07, 2025
  
  19fd57bc
03 Mar, 2025 3 commits
- Share target model embed and head weights for nextn (#4033) · 9fafa62d
  Ke Bao authored Mar 04, 2025
  
  9fafa62d
- Misc clean up; Remove the support of jump forward (#4032) · 935cda94
  Lianmin Zheng authored Mar 03, 2025
  
  935cda94
- Support penalty in overlap mode; return logprob with chunked prefill; improve... · ac238727
  Lianmin Zheng authored Mar 03, 2025
```
Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>
```
  ac238727
27 Feb, 2025 1 commit
- upgrade flashinfer v0.2.2.post1 (#3934) · 564bdf29
  Yineng Zhang authored Feb 27, 2025
  
  564bdf29
24 Feb, 2025 1 commit
- Fix pandas dependency in CI (#3818) · c9745ee0
  Lianmin Zheng authored Feb 24, 2025
  
  c9745ee0
17 Feb, 2025 1 commit
- chore: update flashinfer v0.2.1.post2 (#3644) · 75d171a9
  Yineng Zhang authored Feb 18, 2025
  
  75d171a9
15 Feb, 2025 1 commit
- [CI] Improve Docs CI Efficiency (#3587) · 7443197a
  Shi Shuai authored Feb 15, 2025
```
Co-authored-by: zhaochenyang20 <zhaochen20@outlook.com>
```
  7443197a
14 Feb, 2025 2 commits
- Support NextN (MTP) speculative decoding for DeepSeek-V3/R1 (#3582) · 862dd76c
  Ke Bao authored Feb 15, 2025
  
  862dd76c
- feat: support flashinfer mla attention for deepseek v3 (#3550) · 70f894b8
  Yineng Zhang authored Feb 14, 2025
  
  70f894b8
09 Feb, 2025 1 commit
- remove cutex dependency (#3422) · 4d2dbeac
  Yineng Zhang authored Feb 09, 2025
  
  4d2dbeac
04 Feb, 2025 1 commit
- upgrade flashinfer v0.2.0.post2 (#3288) · d39899e8
  Yineng Zhang authored Feb 04, 2025
```
Co-authored-by: pankajroark <pankajroark@users.noreply.github.com>
```
  d39899e8
25 Jan, 2025 1 commit
- Update whl index path (#3128) · c23d5706
  Ke Bao authored Jan 25, 2025
  
  c23d5706
24 Jan, 2025 2 commits
- Add step to update sgl-kernel whl index (#3110) · 665e5e85
  Ke Bao authored Jan 25, 2025
  
  665e5e85
- [router] Forward all request headers from router to workers (#3070) · 9a0cc2e9
  Byron Hsu authored Jan 23, 2025
  
  9a0cc2e9
20 Jan, 2025 1 commit
- Move sgl.Runtime under sglang/lang (#2990) · 61f42b57
  Lianmin Zheng authored Jan 19, 2025
  
  61f42b57
19 Jan, 2025 1 commit
- [router] Allow empty worker list for sglang.launch_router (#2979) · ef18b0ed
  Byron Hsu authored Jan 19, 2025
  
  ef18b0ed
17 Jan, 2025 1 commit
- update ci install dependency (#2949) · d06c1ab5
  Yineng Zhang authored Jan 17, 2025
  
  d06c1ab5
15 Jan, 2025 1 commit
- Remove normalized_prompt_logprobs from the engine to make code easier to maintain (#2902) · f65c13b5
  Lianmin Zheng authored Jan 15, 2025
  
  f65c13b5
13 Jan, 2025 1 commit
- CUDA-graph-compatible releasing and resuming KV cache and model weight memory (#2630) · 923f5183
  fzyzcjy authored Jan 14, 2025
  
  923f5183
08 Jan, 2025 1 commit
- Improve linear.py to load sharded weights & remove the dependency of Parameters from vllm (#2784) · 8a690612
  Lianmin Zheng authored Jan 07, 2025
```
Co-authored-by: SangBin Cho rkooo567@gmail.com
```
  8a690612