Commits · 88443051a9af17212288270d2cd2b057ebca4b74 · OpenDAS / vllm_cscc

02 Oct, 2025 1 commit

[BugFix][DP/EP] Fix CUTLASS MLA hang under load (#26026) · ebce361c

Lucas Wilkinson authored Oct 01, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

ebce361c

01 Oct, 2025 2 commits

[Bugfix] Fix `__syncwarp` on ROCM (#25996) · febb6883
Zhewen Li authored Sep 30, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
febb6883

[New Model] DeepSeek-V3.2 (Rebased to Main) (#25896) · b3230e1a

Yongye Zhu authored Sep 30, 2025


Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Lucia Fang <116399278+luccafong@users.noreply.github.com>
Co-authored-by: Lucia Fang <fanglu@meta.com>
Co-authored-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Siyuan Fu <siyuanf@nvidia.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Xiaozhu Meng <mxz297@gmail.com>
Co-authored-by: Barry Kang <43644113+Barry-Delaney@users.noreply.github.com>
Signed-off-by: simon-mo <simon.mo@hey.com>

b3230e1a

25 Sep, 2025 2 commits

[Hardware][RISC-V] Add riscv64 support for vLLM with scalar (#22112) · 1e9a77e0
chenlang authored Sep 25, 2025
```
Signed-off-by: chenlang <chen.lang5@zte.com.cn>
Co-authored-by: chenlang <10346245@zte.com.cn>
```
1e9a77e0

[Model] Add LongCat-Flash (#23991) · 845adb3e

XuruiYang authored Sep 25, 2025


Signed-off-by: yangxurui <yangxurui@meituan.com>
Co-authored-by: yangxurui <yangxurui@meituan.com>

845adb3e

24 Sep, 2025 3 commits
- [MISC] replace c10::optional with std::optional (#25602) · 5c1e496a
  Shiyan Deng authored Sep 24, 2025
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
```
  5c1e496a
- [fix]: add Arm 4bit fused moe support (#23809) · 359d2930
  Nikhil Gupta authored Sep 24, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
```
  359d2930
- [Compile] Fix AMD Compile Error (#25518) · bf68fd76
  Wentao Ye authored Sep 23, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bf68fd76
23 Sep, 2025 5 commits

[Bugfix] [B200] cutlass_mla - ensure kv_split == 1 for batch size > 1 (#25509) · 1210e4d9
Alexander Matveev authored Sep 23, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
1210e4d9

[ROCm] Add skinny gemm bias support for dtypes fp16,bf16,fp8 (#24988) · a3a78280

Hashem Hashemi authored Sep 23, 2025


Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
Signed-off-by: Hashem Hashemi <159079214+amd-hhashemi@users.noreply.github.com>

a3a78280

Use macro guard CUDA functions for back compatibility in grouped_topk_kernel.cu (#25346) · 527821d1

Ming Yang authored Sep 23, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Rahul Tuli <rtuli@redhat.com>
Co-authored-by: Claude <noreply@anthropic.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
Co-authored-by: Ye (Charlotte) Qi <yeq@meta.com>

527821d1

[BugFix] Fix UB in per_token_group_quant.cu (#24913) · 2357480b
rivos-shreeasish authored Sep 23, 2025
```
Signed-off-by: Shreeasish Kumar <shreeasish@rivosinc.com>
```
2357480b
add convert_vertical_slash_indexes and convert_vertical_slash_indexes_mergehead · 1e636721
zhuwenwen authored Sep 23, 2025

1e636721

19 Sep, 2025 1 commit
- [Compile] Fix Compile Warning for Ignoring `MIN_BLOCK_PER_SM` (#25193) · 711e9129
  Wentao Ye authored Sep 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  711e9129
18 Sep, 2025 4 commits
- [Model] Add LongCat-Flash · 50281e36
  zhuwenwen authored Sep 18, 2025
  
  50281e36
- silu-v1: Fix EPS not being used during max-reduction (#25069) · abdfcd4f
  Elvir Crnčević authored Sep 18, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  abdfcd4f
- Fix: Add explicit #include <omp.h> for OpenMP compatibility on certain toolchains (#24951) · 4f02b77d
  ihb2032 authored Sep 18, 2025
```
Signed-off-by: lyd1992 <liuyudong@iscas.ac.cn>
Signed-off-by: ihb2032 <1355790728@qq.com>
```
  4f02b77d
- [Kernel] Better inf handling for grouped topk cu (#24886) · 81b16a2b
  Lumina authored Sep 18, 2025
```
Signed-off-by: lumina37 <starry.qvq@gmail.com>
```
  81b16a2b
17 Sep, 2025 6 commits
- [Bugfix] Fix accuracy issue for silu_mul + nvfp4 quant fusion kernel (#24833) · e6585ddb
  elvischenv authored Sep 18, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  e6585ddb
- [Bugfix][B200] Fix `cutlass_mla` hang (#24966) · fedb75fa
  Alexander Matveev authored Sep 17, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  fedb75fa
- [Kernel] Faster pre-processing time for W4A8 (#23972) · 3c068c63
  czhu-cohere authored Sep 17, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3c068c63
- Remove old cutlass mla (#23961) · 8f3616f4
  Matthew Bonanni authored Sep 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  8f3616f4
- Apply fixes for CUDA 13 (#24599) · bfe93801
  Aidyn-A authored Sep 17, 2025
```
Signed-off-by: Aidyn-A <aidyn.b.aitzhan@gmail.com>
```
  bfe93801
- [Bugfix] Fix Stream usage in CPU model runner and OneDNN kernel check (#25046) · 9fccd04e
  Li, Jiang authored Sep 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  9fccd04e
15 Sep, 2025 3 commits

[Bug] Fix Cutlass Scaled MM Compilation Error (#24887) · e757a629
Wentao Ye authored Sep 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e757a629
[Transform] Deterministic Hadacore Transforms (#24106) · a0b26701
Kyle Sayers authored Sep 15, 2025
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
a0b26701

Fp8 paged attention update (#22222) · 01413e0c

xiao-llm authored Sep 15, 2025


Signed-off-by: Xiao Yu <xiao.yu@amd.com>
Signed-off-by: xiao-llm <xiao.yu.dc@outlook.com>
Co-authored-by: Xiao Yu <xiao.yu@metamaterial.com>
Co-authored-by: Xiao Yu <xiao.yu@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

01413e0c

13 Sep, 2025 5 commits
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 26b999c7
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  26b999c7
- [CI Failure] Fix test_flashinfer_cutlass_mxfp4_mxfp8_fused_moe (#24750) · 59d7ffc1
  Michael Goin authored Sep 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  59d7ffc1
- [Kernels][DP/EP] Optimize Silu Kernel for R1 (#24054) · 98229db2
  Elvir Crnčević authored Sep 13, 2025
```
Signed-off-by: elvircrn <elvircrn@gmail.com>
```
  98229db2
- [Perf] Use NVIDIA hardware-accelerated instruction for float to fp8_e4m3 quantization (#24757) · dbeee384
  elvischenv authored Sep 13, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  dbeee384
- [Chore] Remove unused batched RoPE op & kernel (#24789) · 5febdc87
  Woosuk Kwon authored Sep 13, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  5febdc87
12 Sep, 2025 1 commit
- [Doc]: fix typos in various files (#24726) · bcb06d7b
  Didier Durand authored Sep 12, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  bcb06d7b
11 Sep, 2025 5 commits
- [Perf] Use upstream CUTLASS for SM90 Block FP8 kernel (#23280) · c3aea10d
  Michael Goin authored Sep 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  c3aea10d
- [Kernels] Enable Torch Symmetric Memory All-Reduce By Default (#24111) · 1fdd5c42
  Ilya Markov authored Sep 11, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  1fdd5c42
- [Model] New model support for Motif-1-Tiny (#23414) · 9bd831f5
  TaehyunKim authored Sep 11, 2025
```
Signed-off-by: ca1207 <ca1207zzz@gmail.com>
Signed-off-by: TaehyunKim <73943231+ca1207@users.noreply.github.com>
Co-authored-by: WyldeCat <skan1543@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9bd831f5
- skip moe_fused_gate · 9c663e50
  zhuwenwen authored Sep 11, 2025
  
  9c663e50
- add rocm merge_attn_states · 2b8d795b
  zhuwenwen authored Sep 11, 2025
  
  2b8d795b
08 Sep, 2025 1 commit

[Kernel] Support decode context parallelism on Blackwell with CUTLASS MLA (#24385) · 86173ad5

Ming Yang authored Sep 07, 2025


Signed-off-by: Ming Yang <minos.future@gmail.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

86173ad5

07 Sep, 2025 1 commit
- 增加reduce修改 · 3cec42d1
  zhuwenwen authored Sep 07, 2025
  
  3cec42d1