Commits · 8d75f22e79656dddc975c73133fdccbbebc5c963 · OpenDAS / vllm_cscc

07 Dec, 2025 1 commit

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

03 Dec, 2025 2 commits

[Kernels] Remove BatchedTritonOrDeepGemmExperts and default fallback to Triton (#29929) · 2902c348

bnellnm authored Dec 03, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: bnellnm <49004751+bnellnm@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

2902c348

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

30 Nov, 2025 2 commits
- [Feat] Support non-gated activations in NVFP4 modelopt path (#29004) · 39d28108
  Omer Ullman Argov authored Nov 30, 2025
  
  39d28108
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708) · a491b091
  Xin Yang authored Nov 29, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Signed-off-by: Xin Yang <105740670+xyang16@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  a491b091
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
24 Nov, 2025 1 commit
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
22 Nov, 2025 1 commit
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
20 Nov, 2025 1 commit
- [CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) · 322cb028
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  322cb028
19 Nov, 2025 3 commits

[MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50

Shu Wang authored Nov 19, 2025


Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

613abb50

[Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4

Qiu authored Nov 20, 2025


Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>

2fd893b4

Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
a8b70304

16 Nov, 2025 1 commit
- Feature: Support Relu2 in FusedMoE fp8 cutlass path (#27261) · 03ee4811
  amirkl94 authored Nov 16, 2025
  
  03ee4811
15 Nov, 2025 2 commits
- [Misc] Make `SchedulerConfig.max_model_len` init-only (#28733) · 638e4196
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  638e4196
- [Performance][DeepGEMM] Estimate expected_m (#28694) · 6965ef43
  Varun Sundar Rabindranath authored Nov 15, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  6965ef43
13 Nov, 2025 1 commit

[Performance][B200] silu_mul_quant: pack scales in int32 (#28358) · fe1cd770

Varun Sundar Rabindranath authored Nov 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

fe1cd770

11 Nov, 2025 1 commit
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
10 Nov, 2025 2 commits

[Bugfix] Fix persistent_masked_m_silu_mul_quant tests (#28366) · b039bfda

Varun Sundar Rabindranath authored Nov 10, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

b039bfda

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

05 Nov, 2025 1 commit

Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118

amirkl94 authored Nov 05, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6b7a8118

30 Oct, 2025 1 commit

kernels/moe test pruning (#27053) · b8c48c5d

Fardin Hoque authored Oct 29, 2025


Signed-off-by: Fardin Hoque <kfhfar@amazon.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

b8c48c5d

29 Oct, 2025 1 commit
- [Bugfix] Fix modular kernel tests (#27707) · 1891cf60
  bnellnm authored Oct 29, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  1891cf60
26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

23 Oct, 2025 1 commit

[Misc] Add triton_kernels dependency (#27370) · a9f55dc5

Varun Sundar Rabindranath authored Oct 23, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

a9f55dc5

22 Oct, 2025 1 commit

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

19 Oct, 2025 1 commit

[Chore] Separate out `vllm.utils.network_utils` (#27164) · 7a6c8c3f

iAmir97 authored Oct 19, 2025


Signed-off-by: iAmir97 <Amir.balwel@embeddedllm.com>
Co-authored-by: iAmir97 <Amir.balwel@embeddedllm.com>

7a6c8c3f

18 Oct, 2025 1 commit
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
16 Oct, 2025 4 commits

[NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
41d30719

[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to... · b3dda72c

Wentao Ye authored Oct 16, 2025


[Feature] Migrate DeepGEMM API from `get_m_alignment_for_contiguous_layout` to `get_mk_alignment_for_contiguous_layout` (#26935)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b3dda72c

[GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
fb0571b0

[ROCm][FEAT] Fuse DeepSeek shared experts into AITER fused_moe ops (#24097) · 13170343

kliuae authored Oct 16, 2025


Signed-off-by: chenjun <junchen2@amd.com>
Signed-off-by: kliuae <kuanfu.liu@embeddedllm.com>
Co-authored-by: valarLip <103567126+valarLip@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

13170343

14 Oct, 2025 1 commit

[torch.compile] Unwrap fused_marlin_moe custom op (#26739) · 8ae16928

Varun Sundar Rabindranath authored Oct 13, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

8ae16928

12 Oct, 2025 1 commit
- Update `Optional[x]` -> `x | None` and `Union[x, y]` to `x | y` (#26633) · 8fcaaf6a
  Harry Mellor authored Oct 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8fcaaf6a
10 Oct, 2025 1 commit

Silu v2 (#25074) · 7b03584d

Elvir Crnčević authored Oct 10, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: elvircrn <elvircrn@gmail.com>
Signed-off-by: Elvir Crnčević <elvircrn@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>

7b03584d

08 Oct, 2025 1 commit
- [Kernels] Modular kernel refactor (#24812) · da364615
  bnellnm authored Oct 08, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  da364615
07 Oct, 2025 1 commit
- [Feature][OCP MX] Support mxfp6 and mixed mxfp6-mxfp4 (#21166) · 41f1cf38
  fxmarty-amd authored Oct 07, 2025
  
  41f1cf38
06 Oct, 2025 2 commits

Add bias handling to CPUFusedMOE kernel (#26289) · c02058c2

Crefeda Rodrigues authored Oct 06, 2025


Signed-off-by: Crefeda Rodrigues <crefeda.rodrigues@arm.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Crefeda Rodrigues <65665931+cfRod@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Sharif Inamdar <Sharif.Inamdar@arm.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

c02058c2

Fix per file ruff ignores related to line length (#26262) · 6c046382
Harry Mellor authored Oct 06, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
6c046382