Commits · 187b85b7f38496653948a2aba546d53c09ada0f3 · change / sglang

20 Jun, 2025 1 commit
- [PD] Optimize custom mem pool usage and bump mooncake version (#7393) · 187b85b7
  Shangming Cai authored Jun 21, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  187b85b7
09 Jun, 2025 1 commit

chore: upgrade flashinfer v0.2.6.post1 jit (#6958) · 56ccd3c2

Yineng Zhang authored Jun 09, 2025


Co-authored-by: alcanderian <alcanderian@gmail.com>
Co-authored-by: Qiaolin Yu <qy254@cornell.edu>
Co-authored-by: Baizhou Zhang <sobereddiezhang@gmail.com>
Co-authored-by: Mick <mickjagger19@icloud.com>
Co-authored-by: ispobock <ispobaoke@gmail.com>

56ccd3c2

27 May, 2025 1 commit
- chore: upgrade mooncake-transfer-engine (#6643) · f77da699
  Yineng Zhang authored May 26, 2025
  
  f77da699
15 May, 2025 1 commit
- Minor improvements of TokenizerManager / health check (#6327) · e07a6977
  Lianmin Zheng authored May 15, 2025
  
  e07a6977
13 May, 2025 1 commit
- [VERL Use Case] Add torch_memory_saver into deps (#6247) · 1ab14c4c
  Stefan He authored May 12, 2025
  
  1ab14c4c
12 May, 2025 2 commits
- chore: add hf_xet dep (#6243) · f94543d2
  Yineng Zhang authored May 12, 2025
  
  f94543d2
- [CI] Fix PD mooncake dependency error (#6212) · 0f334945
  shangmingc authored May 13, 2025
```
Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>
```
  0f334945
11 May, 2025 3 commits
- [CI] Reorganize the 8 gpu tests (#6192) · 03227c5f
  Lianmin Zheng authored May 11, 2025
  
  03227c5f
- chore: upgrade sgl-kernel v0.1.2.post1 (#6196) · 23010630
  Yineng Zhang authored May 11, 2025
```
Co-authored-by: alcanderian <alcanderian@gmail.com>
```
  23010630
- Add typo checker in pre-commit (#6179) · 2ce87935
  applesaucethebun authored May 11, 2025
```
Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  2ce87935
05 May, 2025 1 commit
- [Test] Add flashmla attention backend test (#5587) · b8559764
  Huapeng Zhou authored May 06, 2025
  
  b8559764
30 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.1.1 (#5933) · 9a6ad891
  Yineng Zhang authored Apr 30, 2025
  
  9a6ad891
28 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.1.0 (#5690) · 41ac0c6d
  Yineng Zhang authored Apr 27, 2025
  
  41ac0c6d
25 Apr, 2025 2 commits
- Pin torch audio to 2.6.0 (#5750) · 3dd3538c
  Lianmin Zheng authored Apr 25, 2025
  
  3dd3538c
- Add MMMU benchmark results (#4491) · 7d9679b7
  Ravi Theja authored Apr 25, 2025
```
Co-authored-by: Ravi Theja Desetty <ravitheja@Ravis-MacBook-Pro.local>
```
  7d9679b7
20 Apr, 2025 1 commit
- [Feat] upgrade pytorch2.6 (#5417) · 417b44eb
  lukec authored Apr 21, 2025
  
  417b44eb
19 Apr, 2025 2 commits
- feat: use flashinfer jit package (#5547) · 0961feef
  Yineng Zhang authored Apr 19, 2025
  
  0961feef
- chore: upgrade sgl-kernel 0.0.9.post2 (#5540) · 2c11f9c2
  Yineng Zhang authored Apr 18, 2025
  
  2c11f9c2
15 Apr, 2025 2 commits
- chore: upgrade sgl-kernel 0.0.9.post1 (#5436) · 8ec0bb7d
  Yineng Zhang authored Apr 15, 2025
  
  8ec0bb7d
- chore: upgrade sgl-kernel 0.0.9 (#5401) · 8aab7fdb
  Yineng Zhang authored Apr 14, 2025
  
  8aab7fdb
13 Apr, 2025 1 commit
- chore: upgrade sgl-kernel 0.0.8.post3 (#5342) · f58b929a
  Yineng Zhang authored Apr 13, 2025
  
  f58b929a
05 Apr, 2025 2 commits
- python transfer custom allreduce from trt kernel to vllm kernel (#5080) · aba5ca15
  Yi Zhang authored Apr 06, 2025
  
  aba5ca15
- upgrade transformers 4.51.0 (#5088) · 0d99adb7
  Yineng Zhang authored Apr 05, 2025
  
  0d99adb7
04 Apr, 2025 1 commit
- upgrade sgl-kernel v0.0.7 (#5049) · e53bf190
  Yineng Zhang authored Apr 03, 2025
  
  e53bf190
03 Apr, 2025 1 commit
- try to fix ci oserror (#5024) · 772d2a19
  Xiaoyu Zhang authored Apr 03, 2025
  
  772d2a19
31 Mar, 2025 1 commit
- use fa3 in sgl-kernel (#4954) · 1c63e797
  Yineng Zhang authored Mar 31, 2025
  
  1c63e797
30 Mar, 2025 1 commit
- Support page size > 1 + eagle (#4908) · b26bc86b
  Lianmin Zheng authored Mar 30, 2025
  
  b26bc86b
29 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.5.post4 (#4873) · d8a136a1
  Yineng Zhang authored Mar 28, 2025
  
  d8a136a1
28 Mar, 2025 1 commit
- Clean up `import vllm` in quantization/__init__.py (#4834) · 74e0ac1d
  Lianmin Zheng authored Mar 28, 2025
  
  74e0ac1d
26 Mar, 2025 1 commit
- Support compressed tensors fp8w8a8 (#4743) · 04e3ff69
  Xiaoyu Zhang authored Mar 27, 2025
  
  04e3ff69
22 Mar, 2025 1 commit
- [Bug Fix] Add partial rotary factor support for Phi-4 and upgrade to transformers v4.50.0 (#3984) · f8f9244a
  Adarsh Shirawalmath authored Mar 23, 2025
```
Co-authored-by: Chayenne <zhaochen20@outlook.com>
```
  f8f9244a
18 Mar, 2025 1 commit
- [Hotfix] solve fp8 w8a8 ci test fail (#4531) · dd865bef
  Xiaoyu Zhang authored Mar 18, 2025
  
  dd865bef
17 Mar, 2025 1 commit

[Feature] Support Deepseek-VL2 (#2798) · d6d21640

萝卜菜 authored Mar 17, 2025


Co-authored-by: Edenzzzz <wtan45@wisc.edu>
Co-authored-by: Chayenne <zhaochen20@outlook.com>
Co-authored-by: Yi Zhang <1109276519@qq.com>

d6d21640

16 Mar, 2025 1 commit
- [Eagle] Remove the greedy branch and some redundant code (#4363) · 1b859295
  Ying Sheng authored Mar 16, 2025
```
Co-authored-by: Sehoon Kim <sehoon@x.ai>
```
  1b859295
15 Mar, 2025 1 commit
- ci: update transformers==4.48.3 (#4451) · 035ac2ab
  Mick authored Mar 16, 2025
  
  035ac2ab
14 Mar, 2025 1 commit
- use topk_softmax with sgl-kernel (#4439) · ad1ae7f7
  Yineng Zhang authored Mar 14, 2025
  
  ad1ae7f7
13 Mar, 2025 2 commits
- Update ci_install_dependency.sh to use accelerate 1.4.0 (#4392) · f141298a
  Lianmin Zheng authored Mar 13, 2025
```
Co-authored-by: wangyu <wangyu.steph@bytedance.com>
Co-authored-by: wangyu <yuwangauto@foxmail.com>
```
  f141298a
- upgrade sgl-kernel 0.0.5 (#4381) · 3623b6a7
  Yineng Zhang authored Mar 13, 2025
  
  3623b6a7
12 Mar, 2025 1 commit
- upgrade sgl-kernel 0.0.4.post3 (#4334) · ed91561f
  Yineng Zhang authored Mar 12, 2025
  
  ed91561f
11 Mar, 2025 1 commit
- upgrade flashinfer 0.2.3 (#4317) · 1cf63485
  Yineng Zhang authored Mar 11, 2025
```
Co-authored-by: qingquansong <qsong@linkedin.com>
```
  1cf63485