Commits · b039bfda8f72b442d42dbdac40f51572bf045ad1 · OpenDAS / vllm_cscc

10 Nov, 2025 2 commits

[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like... · f080a835

vllmellm authored Nov 10, 2025


[RFC][ROCm][AITER] Keep all AITER kernels in `_aiter_ops` class like `_custom_ops` and `_ipex_ops` (#24490)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

f080a835

[Rocm][fused_moe][fp4] view weight to torch.float4_e2m1fn_x2 when running... · b06b9470

zejunchen-zejun authored Nov 10, 2025


[Rocm][fused_moe][fp4] view weight to torch.float4_e2m1fn_x2 when running aiter fused moe for fp4 model (#27474)
Signed-off-by: zejunchen-zejun <zejun.chen@amd.com>

b06b9470

08 Nov, 2025 1 commit
- [XPU] Enable Expert parallel for MoE models (#28263) · 1aaecda0
  Kunshang Ji authored Nov 08, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  1aaecda0
07 Nov, 2025 2 commits
- [Bugfix] Use latency MOE backend as default for Flashinfer and other misc fixes (#27439) · 72b1c2ae
  Pavani Majety authored Nov 07, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  72b1c2ae
- [amd][gptoss] Perf gain because of block alignment (#28024) · 11fd69dd
  smit kadvani authored Nov 06, 2025
```
Signed-off-by: Smit Kadvani <smit.kadvani@gmail.com>
Co-authored-by: Smit Shaileshbhai Kadvani <kadvani@meta.com>
```
  11fd69dd
06 Nov, 2025 1 commit

[ROCm] triton fp8 kernel (#27058) · 449de900

Aleksandr Malyshev authored Nov 06, 2025

Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

449de900

05 Nov, 2025 2 commits

Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118

amirkl94 authored Nov 05, 2025


Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

6b7a8118

[XPU] Add gpt-oss model support for Intel GPU (#27786) · 18b39828
Kunshang Ji authored Nov 05, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
18b39828

04 Nov, 2025 3 commits
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af
- Support using Int4PreshuffledTensor after loading (#26066) · 03c4c4aa
  Jerry Zhang authored Nov 04, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  03c4c4aa
- [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) · 4022a9d2
  Varun Sundar Rabindranath authored Nov 04, 2025
  
  4022a9d2
31 Oct, 2025 1 commit
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
30 Oct, 2025 1 commit

[Feature] Batch invariant torch.compile (#27660) · e7acb200

Paul Zhang authored Oct 30, 2025


Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e7acb200

27 Oct, 2025 2 commits
- [Bugfix][LoRA][FusedMoE] Select MxFP4 Backend based on LoRA Enablement (#27487) · 5d3be3ba
  Varun Sundar Rabindranath authored Oct 27, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  5d3be3ba
- [Misc] Clean up utils (#27552) · 7c2bdb83
  Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7c2bdb83
24 Oct, 2025 3 commits

[Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0

Varun Sundar Rabindranath authored Oct 24, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

269c4db0

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by... · 5cc6bddb
Xiangyu Li authored Oct 24, 2025
```
[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)
```
5cc6bddb

23 Oct, 2025 2 commits
- [Bugfix] Fix AWQ marlin layer skipping (#27416) · 81d5bb76
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  81d5bb76
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
22 Oct, 2025 2 commits

[bugfix] remove unused parameters to reduce unnecessary vram usage (#26789) · 980de31c

Reinforce-II authored Oct 22, 2025


Signed-off-by: Reinforce-II <fate@eastal.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

980de31c

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

21 Oct, 2025 4 commits
- [ROCM] Enable CompressedTensorsWNA16 (#27187) · ba09652d
  JartX authored Oct 21, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
  ba09652d
- [Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e
  Varun Sundar Rabindranath authored Oct 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  5ff5d94e
- [ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) · f95da13c
  Shu Wang authored Oct 21, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  f95da13c
- [Quantization] Automatically infer AWQ `modules_to_not_convert` field (#26909) · 352c0c8a
  Isotr0py authored Oct 21, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  352c0c8a
20 Oct, 2025 1 commit

[Feature][Quantization] auto_round support for mixed bits quantization (#23812) · 87778d5f

Heng Guo authored Oct 21, 2025

Signed-off-by: n1ck-guo <heng.guo@intel.com>
Signed-off-by: Heng Guo <heng.guo@intel.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

87778d5f

19 Oct, 2025 1 commit
- [Misc] Move utils to avoid conflicts with stdlib, and move tests (#27169) · d31f7844
  Cyrus Leung authored Oct 19, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d31f7844
18 Oct, 2025 2 commits
- [Chore] Clean up pytorch helper functions in `vllm.utils` (#26908) · 6ac5e06f
  Isotr0py authored Oct 19, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: isotr0py <2037008807@qq.com>
```
  6ac5e06f
- [Feature] Batch Invariant: Support DeepGEMM and Blackwell (#27127) · 245e4f2c
  Wentao Ye authored Oct 18, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  245e4f2c
17 Oct, 2025 4 commits
- [Bugfix] [AITER] [ROCm] Fix Quark MoE Quant Config and AITER Fused MoE quant type logic (#27029) · e33ee23e
  vllmellm authored Oct 18, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  e33ee23e
- [ROCM] MoE fp4 CK kernel (#26545) · 0925b28a
  Aleksandr Malyshev authored Oct 17, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  0925b28a
- [Docs] Replace `rst` style double-backtick with `md` single-backtick (#27091) · 6c9fdbf7
  Harry Mellor authored Oct 17, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6c9fdbf7
- Remove unused imports (#26972) · 4d055ef4
  Lukas Geiger authored Oct 17, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  4d055ef4
16 Oct, 2025 6 commits
- [NVIDIA] [Perf] Update to leverage flashinfer trtllm FP4 MOE throughput kernel (#26714) · 41d30719
  jiahanc authored Oct 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  41d30719
- [small][batch invariance] Rename the env and internal flags to simplify usage (#26855) · b2f78cba
  Bram Wasti authored Oct 16, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
```
  b2f78cba
- [GPTOSS][DP/EP][Marlin] Enable GPTOSS Batched DP/EP using Marlin kernels (#25997) · fb0571b0
  Varun Sundar Rabindranath authored Oct 16, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fb0571b0
- [Compressed Tensors] Always clone output for compile robustness (#26849) · a5464dcf
  Kyle Sayers authored Oct 16, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  a5464dcf
- [MISC] fix import violations for re and triton modules (#26654) · 00417f4e
  Sungjae Lee authored Oct 16, 2025
```
Signed-off-by: Sungjae Lee <33976427+llsj14@users.noreply.github.com>
Co-authored-by: Mengqing Cao <cmq0113@163.com>
```
  00417f4e
- [Chore] Separate out `vllm.utils.collections` (#26990) · d2740faf
  Cyrus Leung authored Oct 16, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d2740faf