Commits · e7acb200766a0f8f006f9b6fd961dfdceabd7269 · OpenDAS / vllm_cscc

30 Oct, 2025 7 commits

[Feature] Batch invariant torch.compile (#27660) · e7acb200

Paul Zhang authored Oct 30, 2025


Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e7acb200

[Model] Use the same fused_moe configs for all H200 devices (#23642) · 2918c1b4
Roger Meier authored Oct 31, 2025
```
Signed-off-by: Roger Meier <r.meier@siemens.com>
```
2918c1b4
[Bugfix][CPU] Fix MRoPE dispatch on the CPU backend (#27800) · eebf00cb
Li, Jiang authored Oct 30, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
eebf00cb

[Model] Introduce Kimi Linear to vLLM (#27809) · 4e68cc9b

Zhiyuan Li authored Oct 30, 2025


Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
Signed-off-by: Zhiyuan Li <uniartisan2017@gmail.com>

4e68cc9b

[Frontend][Doc][5/N] Improve all pooling task | Polish encode (pooling) api & Document. (#25524) · 4464723f

wang.yuqi authored Oct 30, 2025

Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

4464723f

Add more dims for batch invariant shims (#27489) · ded8ada8

Bram Wasti authored Oct 30, 2025

Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ded8ada8

[XPU][bugfix] fix rope for llama4 and deepseek (#25145) · b798e39f
Yan Ma authored Oct 30, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
b798e39f

29 Oct, 2025 4 commits
- [Bug] Fix DBO IMA issue for DeepEPHT (#27666) · b5d90f74
  Wentao Ye authored Oct 29, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b5d90f74
- [Bug] Fix DeepEP low latency `assert self.batched_router_logits.size(-1) ==... · fcb1d570
  Wentao Ye authored Oct 29, 2025
```
[Bug] Fix DeepEP low latency `assert self.batched_router_logits.size(-1) == full_router_logits.size(-1)` Bug (#27682)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  fcb1d570
- Fix MiniMax-M2 rmsnorm precision and remove useless code (#27627) · d6704dd0
  Roger Young authored Oct 29, 2025
```
Signed-off-by: xuebi <xuebi@minimaxi.com>
Co-authored-by: xuebi <xuebi@minimaxi.com>
```
  d6704dd0
- [Bugfix] Fix non-contiguous tensor error in `rocm_unquantized_gemm_impl` (#27605) · 8b624950
  Zhewen Li authored Oct 29, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  8b624950
28 Oct, 2025 6 commits
- [Test] Batch Invariant: Unit test using parameterized backend (#27478) · 6afc28a9
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6afc28a9
- [FLA] Introduce Kimi Delta Attention(KDA) to VLLM (#27654) · e88bdd60
  Zhiyuan Li authored Oct 28, 2025
```
Signed-off-by: lizhiyuan <lizhiyuan@moonshot.cn>
```
  e88bdd60
- [Bug] Fix shape issue for eplb expert weights (#27589) · 0484b642
  Wentao Ye authored Oct 28, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  0484b642
- [Bugfix] In LongRoPE, decide short vs long based on max_model_len (#27431) · 44b5ce95
  Matthew Bonanni authored Oct 28, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  44b5ce95
- [Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support... · d34f5fe9
  Li, Jiang authored Oct 28, 2025
```
[Bugfix][CPU] Fallback oneDNN linear to torch linear to fix half gemm support on legecy platforms (#27526)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  d34f5fe9
- [Hardware][AMD][Model] Triton MoE tuning configs for GLM-4.6 for MI300X (#27323) · bdb01a38
  Eric Yue authored Oct 28, 2025
```
Signed-off-by: minatoaquaMK2 <jiacheng.yue@foxmail.com>
```
  bdb01a38
27 Oct, 2025 3 commits

[Bugfix][LoRA][FusedMoE] Select MxFP4 Backend based on LoRA Enablement (#27487) · 5d3be3ba
Varun Sundar Rabindranath authored Oct 27, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
5d3be3ba
[Misc] Clean up utils (#27552) · 7c2bdb83
Cyrus Leung authored Oct 27, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
7c2bdb83

[Kernel] Adding split_K implementation for fused_moe_lora (#27291) · 9932ed6a

Danielle Robinson authored Oct 27, 2025


Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Danielle Robinson <dcmaddix@gmail.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9932ed6a

26 Oct, 2025 1 commit

[Chore]:Extract math and argparse utilities to separate modules (#27188) · 71b1c8b6

Yeshwanth N authored Oct 26, 2025


Signed-off-by: Yeshwanth Surya <yeshsurya@gmail.com>
Signed-off-by: Yeshwanth N <yeshsurya@gmail.com>
Signed-off-by: yeshsurya <yeshsurya@gmail.com>

71b1c8b6

24 Oct, 2025 4 commits

[Misc][DP] Guard mxfp4 implementation selection (#27484) · 269c4db0

Varun Sundar Rabindranath authored Oct 24, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

269c4db0

[Log] Optimize Startup Log (#26740) · 52efc34e
Wentao Ye authored Oct 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
52efc34e

[MISC] `cudagraph_capture_sizes` related improvements (#26016) · 284cc922

fhl2000 authored Oct 24, 2025

Signed-off-by: fhl <2410591650@qq.com>
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

284cc922

[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by... · 5cc6bddb
Xiangyu Li authored Oct 24, 2025
```
[Kernel] Add GPTQv2 format support for low-bit or asymmetric quantization, by adapting gptq_gemm (#26092)
```
5cc6bddb

23 Oct, 2025 6 commits
- [Hardware][POWERPC] Disable oneDNN path in vllm/model_executor/layers/utils.py for Powerpc (#27422) · f417746a
  Akash kaothalkar authored Oct 24, 2025
```
Signed-off-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
Co-authored-by: Akash Kaothalkar <akash.kaothalkar@ibm.com>
```
  f417746a
- [Bugfix] Fix AWQ marlin layer skipping (#27416) · 81d5bb76
  Isotr0py authored Oct 24, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  81d5bb76
- [Bugfix][ROCm][DeepSeek] Fix for forward_hip in rope for DeepSeek (#27373) · 0825197b
  Gregory Shtrasberg authored Oct 23, 2025
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  0825197b
- [Bugfix] Fix dp_chunking enablement logic in FusedMoE layer (#27220) · 9ef3d5b8
  Alexander Matveev authored Oct 23, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
  9ef3d5b8
- [Frontend][4/N] Improve all pooling task | Add plugin pooling task (#26973) · 3fa2c121
  wang.yuqi authored Oct 23, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Christian Pinto <christian.pinto@ibm.com>
```
  3fa2c121
- [Model] Add MoE support for NemotronH (#25863) · 61089465
  tomeras91 authored Oct 23, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  61089465
22 Oct, 2025 4 commits

[bugfix] remove unused parameters to reduce unnecessary vram usage (#26789) · 980de31c

Reinforce-II authored Oct 22, 2025


Signed-off-by: Reinforce-II <fate@eastal.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

980de31c

[Bug] Fix DeepSeek-V2.5-1210-FP8 issue (#27267) · 1c160841
Wentao Ye authored Oct 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1c160841

[Chore] Separate out optional dependency checks from vllm.utils (#27207) · 3ae082c3

dongbo910220 authored Oct 22, 2025

Signed-off-by: dongbo910220 <1275604947@qq.com>
Signed-off-by: dongbo910220 <32610838+dongbo910220@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

3ae082c3

[torch.compile] Enable silu_mul_fp8_quant fusion without custom ops enabled (#27146) · ab3e8004
Jiangyun Zhu authored Oct 22, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
ab3e8004

21 Oct, 2025 5 commits

[Performance] Dual stream execution of "shared_experts" and "selected_experts"... · 344a0017

Alexander Matveev authored Oct 21, 2025


[Performance] Dual stream execution of "shared_experts" and "selected_experts" inside FusedMoE (#26440)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>

344a0017

[Feature] Batch Invariant for R1 TP 8 on Blackwell (#27229) · 86ed7702
Wentao Ye authored Oct 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
86ed7702
[ROCM] Enable CompressedTensorsWNA16 (#27187) · ba09652d
JartX authored Oct 21, 2025
```
Signed-off-by: JartX <sagformas@epdcenter.es>
```
ba09652d

[Bugfix] Fix gpt-oss w4a8 DP/EP on B200 (#26729) · 5ff5d94e

Varun Sundar Rabindranath authored Oct 21, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

5ff5d94e

[ModelOpt] Load w13/w2_input_scale for all experts, nvfp4 (#26135) · f95da13c

Shu Wang authored Oct 21, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f95da13c