Commits · 31aedfe7d62adea6b5a7644f3c323f585b042ce3 · OpenDAS / vllm_cscc

31 Jan, 2026 2 commits
- [Bugfix][ROCm] Fixing the skinny gemm dispatch logic from #32831 (#33366) · 31aedfe7
  Gregory Shtrasberg authored Jan 30, 2026
```
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
```
  31aedfe7
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 6 commits

[Hardware][SM100] Add TRTLLM Kernel for INT4 W4A16 Kernel. (#32437) · c3a9752b
Pavani Majety authored Jan 30, 2026
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
c3a9752b

[Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next... · f451b455

xuebwang-amd authored Jan 31, 2026


[Quantization][ROCm] Fix MoE weight loading to be robust (Qwen3_MoE/Qwen3_next as example models) (#33173)
Signed-off-by: xuebwang-amd <xuebwang@amd.com>

f451b455

Support FP8 block quant for CompressedTensorsW8A16Fp8 (#33280) · fd0e3772
Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
fd0e3772

Disable Cascade Attention for Batch Invariance (#32561) · 8f5d5120

Frank Wang authored Jan 30, 2026

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

8f5d5120

[Misc] Replace Optional[X] with X | None syntax (#33332) · 1a7894db

杨朱 · Kiki authored Jan 30, 2026


Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

1a7894db

[model] Add support for openPangu7B-VL (#32449) · ba45bedf

hujiaxin0 authored Jan 30, 2026

Signed-off-by: hujiaxin <524446785@qq.com>
Signed-off-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>
Co-authored-by: Emilie1001 <79921183+Emilie1001@users.noreply.github.com>

ba45bedf

29 Jan, 2026 9 commits
- [Bugfix] Enable Triton MoE for FP8 per-tensor dynamic (#33300) · bfb9bdaf
  Michael Goin authored Jan 29, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bfb9bdaf
- Add Triton fused MoE config for B200 (Nemotron Nano) (#32804) · 8e2a469b
  danisereb authored Jan 29, 2026
  
  8e2a469b
- [Bugfix][Kernel] Fix negative memory offset in GDN Triton kernel (#33326) · 23591e63
  CarstyYou authored Jan 30, 2026
```
Signed-off-by: CarstyYou <186021327+CarstyYou@users.noreply.github.com>
```
  23591e63
- [NVIDIA] [feat] Integrate flashinfer Trtllmgen bf16 moe (#32954) · 0493d897
  Linda authored Jan 29, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
```
  0493d897
- [Quantization][Refactor] use platform dict to choose kernel (#33130) · a5aa4d5c
  zofia authored Jan 29, 2026
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
Signed-off-by: zofia <110436990+zufangzhu@users.noreply.github.com>
```
  a5aa4d5c
- [PluggableLayer][2/N] Apply PluggableLayer to linear layers (#33152) · 08b1195e
  whx authored Jan 29, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  08b1195e
- [Doc]: fixing multiple typos in diverse files (#33256) · 31b25f65
  Didier Durand authored Jan 29, 2026
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Didier Durand <2927957+didier-durand@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  31b25f65
- [ez] Delete more torch version checks <= 2.8 (#33288) · 07ea184f
  Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  07ea184f
- [UX] Remove noisy CT UnquantizedLinearMethod warn (#33273) · 141cd439
  Michael Goin authored Jan 28, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  141cd439
28 Jan, 2026 6 commits

[ez] Remove checks for torch version <= 2.8 (#33209) · 4197168e
Angela Yi authored Jan 28, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
4197168e
Use aiter triton fused_add_rmsnorm_pad for gpt-oss (#30976) · 59bcc5b6
Rohan Potdar authored Jan 28, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
59bcc5b6

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

[CI] Enable mypy import following for `vllm/compilation` (#33199) · f1acbd68
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
f1acbd68
Add flake8-implicit-str-concat rules to Ruff (#33191) · 2eb673a0
Harry Mellor authored Jan 28, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
2eb673a0

27 Jan, 2026 6 commits
- [torch.compile] Speed up MOE handling in forward_context (#33184) · d9aa39a3
  Richard Zou authored Jan 27, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d9aa39a3
- [Attention] Use `has_flashinfer` helper (#33177) · 1cbccb6d
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  1cbccb6d
- Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4... · 66e601ef
  IriKa authored Jan 28, 2026
```
Support compress-tensors with nvfp4 or fp8 weights and modelopt with nvfp4 weights on Turing (#33076)
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>
```
  66e601ef
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
- [AMD][QWEN3-NEXT] FP8 Tunings (#32042) · da8d0c44
  Lifan Shen authored Jan 27, 2026
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
  da8d0c44
- [MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916
  Robert Shaw authored Jan 26, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>
```
  5a93b916
26 Jan, 2026 6 commits

[Bugfix][TPU] Return a Default fp8 MoE Backend (#32908) · 510ed1e8

XiongfeiWei authored Jan 26, 2026


Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

510ed1e8

[Bugfix][MXFP4] Call `trtllm_fp4_block_scale_moe` with kwargs (#33104) · 8caffd92
Pengchao Wang authored Jan 26, 2026
```
Signed-off-by: Pengchao Wang <wpc@fb.com>
```
8caffd92
[Refactor] Remove unused `_moe_permute` function (#33108) · 8f987883
Wentao Ye authored Jan 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
8f987883

[Bugfix] Fix Dtypes for Pynccl Wrapper (#33030) · 43a013c3

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

43a013c3

[FIX] Always support TP > 4 for FP4 Gemm (#31099) · 67fe677c

danielafrimi authored Jan 26, 2026


Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@gpu-51.slurm-workers-slurm.slurm.svc.cluster.local>

67fe677c

[Performance] Tune Mamba selective scan kernel for B200 (#32873) · f4a0921c

danisereb authored Jan 26, 2026


Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f4a0921c

25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
24 Jan, 2026 3 commits

[MLA] Fuse cat and qaunt for fp8 kv-cache (#32950) · da5e7b12
Lucas Wilkinson authored Jan 24, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
da5e7b12
[Models]: Make Multimodal config implicit in ViT implementation (#31972) · 9ad7f89f
Isotr0py authored Jan 24, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
9ad7f89f

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

23 Jan, 2026 1 commit
- [Bugfix] Fix missing is_layer_skipped check for FusedMoE in AWQConfig (#32935) · ebd0a17e
  joninco authored Jan 23, 2026
```
Signed-off-by: jon <joninco@bullpoint.org>
```
  ebd0a17e