Commits · fa59fe417f509641fed102dfa2e3b8a63f224241 · OpenDAS / vllm_cscc

29 Nov, 2025 1 commit
- [Doc]: fixing typos in various files. (#29717) · 04a797cd
  Didier Durand authored Nov 29, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  04a797cd
28 Nov, 2025 2 commits
- Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697) · 3fd1fb0b
  Huamin Li authored Nov 28, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  3fd1fb0b
- [LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971) · 745a3bae
  Xin Yang authored Nov 27, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  745a3bae
27 Nov, 2025 3 commits

[Attention] Update attention imports (#29540) · fc1d8be3
Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
fc1d8be3

[Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c

Jinzhen Lin authored Nov 27, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a67dec7c

[Bugfix] Make compressed-tensors MoEs respect ignored layers (#28878) · df01eda4
HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
```
df01eda4

26 Nov, 2025 5 commits
- [Attention] Remove imports from `vllm/attention/__init__.py` (#29342) · 430dd4d9
  Matthew Bonanni authored Nov 26, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  430dd4d9
- [refactor] CTConfig methods to static/class methods (#28870) · e6031295
  HDCharles authored Nov 26, 2025
```
Signed-off-by: HDCharles <charlesdavidhernandez@gmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e6031295
- [Perf] Optimize batch invariant BMM, 18.1% Throughput improvement, 10.7% TTFT improvement (#29345) · 0b0aa874
  Wentao Ye authored Nov 26, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0b0aa874
- Revert "[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841)" (#29483) · 70d5953f
  Huamin Li authored Nov 26, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  70d5953f
- [Kernel] Use pre-allocated output buffer for triton kernel fused_experts (#29219) · 53d7f1f6
  Xin Yang authored Nov 25, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  53d7f1f6
25 Nov, 2025 7 commits

Change warning logs to debug for unimplemented MXFP4 Linear/Attention (#29441) · 7df02897
Michael Goin authored Nov 25, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
7df02897
[Kernel] Add NVFP4 MoE CUTLASS support for SM120 (#29242) · e5020986
Michael Goin authored Nov 25, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
e5020986
[Bugfix] Fix GPT-OSS AR+NORM fusion (#28841) · 6330f947
elvischenv authored Nov 25, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
6330f947
[fix][cpu] Use a SwigluOAI impl which supports interleaved gate-up wei (#29273) · 98caeadd
Fadi Arafeh authored Nov 25, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
98caeadd

[Model] Add HunyuanOCR support (#29327) · 92effb07

Isotr0py authored Nov 25, 2025


Signed-off-by: manayang <jackmanayang@gmail.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: sergeywang <sergeywang@tencent.com>
Co-authored-by: manayang <jackmanayang@gmail.com>
Co-authored-by: manayang <manayang@tencent.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

92effb07

[Perf] Disable DeepGEMM MoE by default when TP=8 is used (#29346) · 6f1355a1
Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
6f1355a1
[UX] Raise error for attn backend of batch invariant (#29348) · 699bca76
Wentao Ye authored Nov 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
699bca76

24 Nov, 2025 2 commits
- [Bugfix] Only use triton_kernels for MXFP4 on SM90 and SM100 (#29339) · c17610e2
  Michael Goin authored Nov 24, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  c17610e2
- [MoE][Refactor] Make select_experts a non-static method (#29067) · 8f066146
  bnellnm authored Nov 24, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  8f066146
23 Nov, 2025 1 commit

[Fix] Add SM check to flashinfer MOE backend (#29144) · 5f96c00c

jiahanc authored Nov 22, 2025


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

5f96c00c

22 Nov, 2025 5 commits
- chore: add RTX_PRO_6000 GLM4.6-FP8 kernel tuning (#29240) · f55c76c2
  Federico authored Nov 22, 2025
  
  f55c76c2
- [tiny] Remove unsupported TRITON_MLA backend from batch invariance (#28832) · 5f7209a7
  Bram Wasti authored Nov 22, 2025
```
Signed-off-by: Bram Wasti <bwasti@meta.com>
Signed-off-by: Bram Wasti <bwasti@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  5f7209a7
- Handle triton kernel import exception (#29062) · 988ee66b
  jinghanhu authored Nov 22, 2025
  
  988ee66b
- Add fused MoE config for H200 E160 N192 fp8 (#29182) · 052950e5
  FlintyLemming authored Nov 22, 2025
```
Signed-off-by: FlintyLemming <admin@flinty.moe>
```
  052950e5
- [Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217) · d045e22d
  Lukas Geiger authored Nov 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  d045e22d
21 Nov, 2025 10 commits

[BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
3137991f

[BugFix] Make sure to allocate worst case MoE workspace during profile run in... · 1840c5cb

Lucas Wilkinson authored Nov 21, 2025


[BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

1840c5cb

Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) · b4c8fbaa

Mingyuan Ma authored Nov 21, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

b4c8fbaa

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in... · e99e4673

rasmith authored Nov 21, 2025


[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

e99e4673

[Log] Optimize startup log (#28948) · a42ab317

Wentao Ye authored Nov 21, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

a42ab317

Upstream triton fp4 weight preshuffle (#28888) · b7f1f490

Aleksandr Malyshev authored Nov 21, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>

b7f1f490

[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a
[ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) · 3f5f36da
Hongxia Yang authored Nov 20, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
3f5f36da
[Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e1eefa4c

[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput... · df44df01

Wentao Ye authored Nov 20, 2025


[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

df44df01

20 Nov, 2025 3 commits
- Add truncate arg to yarn to match openai implementation of gpt-oss (#28244) · 6eb745d9
  Anna Shors authored Nov 20, 2025
```
Signed-off-by: ashors1 <ashors@nvidia.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  6eb745d9
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
19 Nov, 2025 1 commit
- [Refactor] Optimize `select_experts` (#28069) · 5031cd5d
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5031cd5d