Commits · 9df8da548e920f83d4f7710e481f106c2ac92d31 · OpenDAS / vllm_cscc

24 Sep, 2025 1 commit
- [Compile] Fix AMD Compile Error (#25518) · bf68fd76
  Wentao Ye authored Sep 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bf68fd76
23 Sep, 2025 4 commits

[Bugfix] [B200] cutlass_mla - ensure kv_split == 1 for batch size > 1 (#25509) · 1210e4d9
Alexander Matveev authored Sep 23, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
1210e4d9

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

Use macro guard CUDA functions for back compatibility in grouped_topk_kernel.cu (#25346) · 527821d1

Ming Yang authored Sep 23, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

527821d1

[BugFix] Fix UB in per_token_group_quant.cu (#24913) · 2357480b
rivos-shreeasish authored Sep 23, 2025
```
Signed-off-by: Shreeasish Kumar <shreeasish@rivosinc.com>
```
2357480b

19 Sep, 2025 1 commit
- [Compile] Fix Compile Warning for Ignoring `MIN_BLOCK_PER_SM` (#25193) · 711e9129
  Wentao Ye authored Sep 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  711e9129
18 Sep, 2025 3 commits
- silu-v1: Fix EPS not being used during max-reduction (#25069) · abdfcd4f
  Elvir Crnčević authored Sep 18, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  abdfcd4f
- Fix: Add explicit #include <omp.h> for OpenMP compatibility on certain toolchains (#24951) · 4f02b77d
  ihb2032 authored Sep 18, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  4f02b77d
- [Kernel] Better inf handling for grouped topk cu (#24886) · 81b16a2b
  Lumina authored Sep 18, 2025
```
Signed-off-by: lumina37 <starry.qvq@gmail.com>
```
  81b16a2b
17 Sep, 2025 6 commits
- [Bugfix] Fix accuracy issue for silu_mul + nvfp4 quant fusion kernel (#24833) · e6585ddb
  elvischenv authored Sep 18, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e6585ddb
- [Bugfix][B200] Fix `cutlass_mla` hang (#24966) · fedb75fa
  Alexander Matveev authored Sep 17, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  fedb75fa
- [Kernel] Faster pre-processing time for W4A8 (#23972) · 3c068c63
  czhu-cohere authored Sep 17, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3c068c63
- Remove old cutlass mla (#23961) · 8f3616f4
  Matthew Bonanni authored Sep 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  8f3616f4
- Apply fixes for CUDA 13 (#24599) · bfe93801
  Aidyn-A authored Sep 17, 2025
```
Signed-off-by: Aidyn-A <aidyn.b.aitzhan@gmail.com>
```
  bfe93801
- [Bugfix] Fix Stream usage in CPU model runner and OneDNN kernel check (#25046) · 9fccd04e
  Li, Jiang authored Sep 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9fccd04e
15 Sep, 2025 3 commits

[Bug] Fix Cutlass Scaled MM Compilation Error (#24887) · e757a629
Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e757a629
[Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
a0b26701

Fp8 paged attention update (#22222) · 01413e0c

xiao-llm authored Sep 15, 2025


Signed-off-by: Xiao Yu <xiao.yu@amd.com>
Signed-off-by: xiao-llm <xiao.yu.dc@outlook.com>
Co-authored-by: Xiao Yu <xiao.yu@metamaterial.com>
Co-authored-by: Xiao Yu <xiao.yu@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

01413e0c

13 Sep, 2025 4 commits
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 59d7ffc1
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  59d7ffc1
- [Kernels][DP/EP] Optimize Silu Kernel for R1 (#24054) · 98229db2
  Elvir Crnčević authored Sep 13, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  98229db2
- [Perf] Use NVIDIA hardware-accelerated instruction for float to fp8_e4m3 quantization (#24757) · dbeee384
  elvischenv authored Sep 13, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  dbeee384
- [Chore] Remove unused batched RoPE op & kernel (#24789) · 5febdc87
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5febdc87
12 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
11 Sep, 2025 3 commits

[Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d

Michael Goin authored Sep 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

c3aea10d

[Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
1fdd5c42

[Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5

TaehyunKim authored Sep 11, 2025


Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

9bd831f5

08 Sep, 2025 1 commit

[Kernel] Support decode context parallelism on Blackwell with CUTLASS MLA (#24385) · 86173ad5

Ming Yang authored Sep 07, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

86173ad5

06 Sep, 2025 3 commits

[Bugfix] Avoid uninitialized usage of azp_val when AZP is false. (#24335) · 0eadaeff
mohankku authored Sep 06, 2025
```
Signed-off-by: Mohan Kumar Kumar <mohan.cbein@gmail.com>
Signed-off-by: mohankku <mohan.cbein@gmail.com>
```
0eadaeff

[Feature] Support Decode Context Parallel (DCP) for MLA (#23734) · ac201a0e

yzds authored Sep 06, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: youkaichao <youkaichao@gmail.com>

ac201a0e

[Doc]: fix typos in Python comments (#24294) · 35bf1938

Didier Durand authored Sep 06, 2025


Signed-off-by: Didier Durand <durand.didier@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

35bf1938

04 Sep, 2025 3 commits

[Bugfix][Misc] Fix silu_and_mul_nvfp4_quant issue and extract common utils for... · adc3ddb4

elvischenv authored Sep 05, 2025


[Bugfix][Misc] Fix silu_and_mul_nvfp4_quant issue and extract common utils for nvfp4 kernel source files (#23727)
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

adc3ddb4

[CPU] Refactor CPU unquantized linear (#24150) · 57b1ce94
Li, Jiang authored Sep 04, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
57b1ce94
[Kernel][Bugfix] Fix grouped topk cu (#24146) · e919d6f5
Qiming Zhang authored Sep 03, 2025
```
Signed-off-by: mayuyuace <qiming1.zhang@intel.com>
```
e919d6f5

03 Sep, 2025 3 commits
- [Attention] Blackwell FP8 MLA support with CUTLASS_MLA backend (#23289) · a7423220
  Matthew Bonanni authored Sep 03, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a7423220
- [Compile] Fix Compile Warning for `w4a8_mm_entry.cu` (#23660) · c4ed78b1
  Wentao Ye authored Sep 02, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  c4ed78b1
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
02 Sep, 2025 1 commit
- [V1][Mamba1] - FP32 SSM Kernel Support (#23506) · 2b41cbbf
  Asaf Joseph Gardin authored Sep 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  2b41cbbf
29 Aug, 2025 2 commits

[BUGFIX ] fix undefined silu_and_mul_nvfp4_quant (#23929) · 0dc95320

yzds authored Aug 30, 2025


Signed-off-by: hongchao <hongchao@msh.team>
Signed-off-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: hongchao <hongchao@msh.team>
Co-authored-by: Richard Zou <zou3519@gmail.com>
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com>

0dc95320

[ROCm][Fix] Fix rocm build caused by #23791 (#23847) · 006477e6
Charlie Fu authored Aug 28, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
006477e6

28 Aug, 2025 1 commit

[NVIDIA] Support SiluMul + NVFP4 quant fusion (#23671) · 16a45b3a

elvischenv authored Aug 29, 2025


Signed-off-by: jindih <jindih@nvidia.com>
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: jindih <jindih@nvidia.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Luka Govedic <lgovedic@redhat.com>

16a45b3a