Commits · 171775f306a333a9cf105bfd533bf3e113d401d9 · OpenDAS / vllm_cscc

28 Mar, 2026 1 commit

Fix Device Index for ROCm Ray Workers in MoE Benchmark (#38108) · 171775f3

Liwen authored Mar 28, 2026


Signed-off-by: Liwen <53441624+li-liwen@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

171775f3

26 Mar, 2026 1 commit
- [Bugfix] Fix benchmark_fused_collective.py (#38082) · 2bfbdca2
  Jee Jee Li authored Mar 26, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2bfbdca2
25 Mar, 2026 1 commit
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
23 Mar, 2026 1 commit
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
19 Mar, 2026 1 commit
- Stop bench CLI from recursively casting all configs to `dict` (#37559) · 572b4329
  Harry Mellor authored Mar 19, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  572b4329
18 Mar, 2026 2 commits
- [Perf] Add tuned triton moe config for Qwen3.5 H200, 9.9% E2E throughput improvement (#37340) · 0ef7f790
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0ef7f790
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
17 Mar, 2026 1 commit
- [Torch 2.11] Guard torch._C._cpu attribute checks for forward compatibility (#35673) · 68f783a7
  Andrey Talman authored Mar 17, 2026
```
Signed-off-by: atalman <atalman@fb.com>
```
  68f783a7
16 Mar, 2026 2 commits
- [Benchmark] Improvements to attention benchmark script (#37115) · a3a51d20
  Wei Zhao authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
```
  a3a51d20
- [Hardware] Replace memory related torch.cuda APIs (#37031) · 747b0681
  Kunshang Ji authored Mar 16, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  747b0681
12 Mar, 2026 3 commits
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
  Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  894843eb
09 Mar, 2026 3 commits

[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8

Roberto L. Castro authored Mar 09, 2026


[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>

580864d8

[Attention][Perf] Optimize cp_gather_and_upconvert_fp8_kv_cache - DeepSeek-v3.2 (#35290) · 2b28b9b2
Roberto L. Castro authored Mar 09, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
```
2b28b9b2
Allow `markdownlint` to run locally (#36398) · a0f44bb6
Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a0f44bb6

07 Mar, 2026 1 commit
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

02 Mar, 2026 1 commit
- [Doc] Improve UX of `--enable-log-requests` (#35723) · 792a74b9
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  792a74b9
26 Feb, 2026 3 commits
- [Refactor] Remove dead code for attention benchmark script (#35418) · 05970c77
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05970c77
- [Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
  Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  05972ea7
- [Kernel] Refactor FlashInfer allreduce for mnnvl backend (#34109) · 71dfce6a
  Hanjie Qiu authored Feb 25, 2026
```
Signed-off-by: hjjq <50634613+hjjq@users.noreply.github.com>
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Wei Zhao <51183510+wzhao18@users.noreply.github.com>
```
  71dfce6a
24 Feb, 2026 1 commit

[Perf] Improve default triton fused moe configs (#34846) · 22a97e66

Michael Goin authored Feb 23, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

22a97e66

23 Feb, 2026 1 commit
- [Bugfix] Fix kernel benchmark (#33752) · 7291d1b2
  Jee Jee Li authored Feb 23, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  7291d1b2
20 Feb, 2026 1 commit

[Bugfix] Fix benchmark_fused_collective crash on CustomOp init (#34665) · 648951a9

Mayank Ketkar authored Feb 19, 2026


Signed-off-by: Mayank Ketkar <mketkar@zoox.com>
Signed-off-by: Mayank Ketkar <mayket04@gmail.com>
Co-authored-by: Mayank Ketkar <mketkar@zoox.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

648951a9

17 Feb, 2026 2 commits

[Kernel] Triton-based Top-k and Top-p sampler kernels (#33538) · c656ba3b

Jongseok Park authored Feb 17, 2026


Signed-off-by: js_park <cakeng@naver.com>
Signed-off-by: Jongseok Park <37990712+cakeng@users.noreply.github.com>
Signed-off-by: Sunga Kim <sunga.kim@berkeley.edu>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Sunga Kim <sunga.kim@berkeley.edu>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

c656ba3b

[CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
c61a98f5

13 Feb, 2026 1 commit
- [Perf] fused_moe: add int4_w4a16 benchmark support and tuning config (#34130) · 934acdde
  Matthias Gehre authored Feb 13, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  934acdde
12 Feb, 2026 2 commits

[Attention] Add FlashInfer Sparse MLA backend (#33451) · f2c47886

Matthew Bonanni authored Feb 12, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

f2c47886

[Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
ff1f83b0

11 Feb, 2026 1 commit
- [Bugfix] Fix benchmark_moe.py inplace assertion with torch >= 2.9 (#34149) · 7a048ee6
  Matthias Gehre authored Feb 11, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  7a048ee6
09 Feb, 2026 3 commits
- [Kernel] FlashInfer: switch allreduce fusion to unified API (#33985) · d4f123cc
  Mohammad Miadh Angkad authored Feb 09, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  d4f123cc
- [Misc] Fix up attention benchmarks (#33810) · d0d97e29
  Lucas Wilkinson authored Feb 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  d0d97e29
- [Model] GLM adaptation (#34124) · 978a37c8
  Jee Jee Li authored Feb 09, 2026
  
  978a37c8
06 Feb, 2026 2 commits
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
- [Docs] Update link to Benchmark CLI documentation (#33254) · 5c52644b
  Eldar Kurtić authored Feb 06, 2026
```
Signed-off-by: Eldar Kurtić <8884008+eldarkurtic@users.noreply.github.com>
```
  5c52644b
02 Feb, 2026 1 commit
- Add unpermute-aware fused MoE LoRA path (#32655) · 7320ca39
  Runkai Tao authored Feb 01, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
```
  7320ca39