Commits · 4d51588e2381018348f1022dfa3a7698899805b7 · OpenDAS / vllm_cscc

27 Apr, 2026 1 commit

[Feat] DeepSeek V4 Rebased (#40860) · 4d51588e

Yifan Qiao authored Apr 26, 2026


Signed-off-by: Yifan Qiao <yifanqiao@inferact.ai>
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
Signed-off-by: qizixi <zixi@inferact.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Yongye Zhu <yongye@inferact.ai>
Co-authored-by: Simon Mo <simon@inferact.ai>
Co-authored-by: Bugen Zhao <i@bugenzhao.com>
Co-authored-by: Giancarlo Delfin <gdelfin@inferact.ai>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roy Wang <yasong.wang@inferact.ai>
Co-authored-by: Woosuk Kwon <woosuk@inferact.ai>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Zhewen Li <jerven.vllm@gmail.com>
Co-authored-by: Zijing Liu <liuzijing2014@gmail.com>
Co-authored-by: khluu <khluu000@gmail.com>
Co-authored-by: qizixi <zixi@inferact.ai>
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>

4d51588e

21 Apr, 2026 1 commit
- fix: clamp NaN/Inf in topk_softmax to prevent duplicate expert IDs (#39391) · 28c22215
  Jhao-Ting Chen authored Apr 21, 2026
```
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
```
  28c22215
02 Apr, 2026 1 commit
- Revert "[Kernel] Add gpt-oss Router GEMM kernel (#37205)" (#38778) · 9bd72311
  Xin Yang authored Apr 01, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  9bd72311
01 Apr, 2026 1 commit
- [Kernel] Add MXFP8 to Marlin GEMM/MoE and refactor Mxfp8LinearOp (#34664) · db5d0719
  Michael Goin authored Apr 01, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  db5d0719
27 Mar, 2026 1 commit
- [Bugfix]fix output Nan/Inf in marlin if dtype=float16 (#33972) · 148a5c12
  IriKa authored Mar 28, 2026
```
Signed-off-by: IriKa Qiu <qiujie.jq@gmail.com>
```
  148a5c12
18 Mar, 2026 1 commit
- [Kernel] Add gpt-oss Router GEMM kernel (#37205) · b1169d7b
  Xin Yang authored Mar 18, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1169d7b
16 Mar, 2026 1 commit
- [Compile] Fix compile warning in `moe_permute` (#36529) · e855d380
  Wentao Ye authored Mar 16, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e855d380
05 Mar, 2026 1 commit

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

02 Mar, 2026 1 commit

[Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a

EdalatiAli authored Mar 02, 2026


Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

cb21972a

27 Feb, 2026 1 commit
- [Performance] Cublas Bf16 Gate with Fp32 Output (#35121) · 38c498b8
  roikoren755 authored Feb 27, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  38c498b8
25 Feb, 2026 1 commit
- [Bugfix] Fix expert_ids padding values in moe_align_block_size kernel (#35161) · 3bbb2046
  Xin Yang authored Feb 24, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  3bbb2046
24 Feb, 2026 1 commit
- [Bugfix] Fix DSV3 kernels breaking _C and _moe_C on unsupported arches (#35123) · 3ef9fd0f
  Michael Goin authored Feb 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  3ef9fd0f
23 Feb, 2026 1 commit
- [ModelBash][DSV3] Add TRTLLM DSV3 Router GEMM kernel (6% B1 Speedup) (#34302) · 8435b2e0
  Robert Shaw authored Feb 23, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  8435b2e0
20 Feb, 2026 1 commit
- [Kernel] Optimize grouped topk kernel (#34206) · b1c4f0b2
  Xin Yang authored Feb 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  b1c4f0b2
06 Feb, 2026 1 commit
- [Refactor] Remove align block size logic in `moe_permute` (#33449) · 77c09e11
  Wentao Ye authored Feb 06, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  77c09e11
31 Jan, 2026 1 commit

[Bugfix]: Fix display errors in TORCH_CHECK messages (#32942) · fedf6433

linhaifeng authored Feb 01, 2026


Signed-off-by: linhaifeng <1371675203@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

fedf6433

28 Jan, 2026 1 commit
- [Perf] Optimize `moe_permute` for CUTLASS FP8 (#32892) · c4e744db
  Wentao Ye authored Jan 28, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c4e744db
23 Jan, 2026 1 commit
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
21 Jan, 2026 1 commit
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
20 Jan, 2026 1 commit
- [Perf] Only clone when needed for `moe_permute` (#32273) · 6c97b9b9
  Wentao Ye authored Jan 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  6c97b9b9
16 Jan, 2026 1 commit
- Add thread_n=64 support to Marlin MoE (#32360) · 83239ff1
  Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  83239ff1
13 Jan, 2026 1 commit
- [Perf] Optimize grouped topk kernel, 1.2%~2% E2E Throughput improvement (#32058) · f28125d8
  Wentao Ye authored Jan 13, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f28125d8
07 Jan, 2026 1 commit
- [Kernel] Support bias type in grouped_topk kernel (#31781) · 0ada960a
  Xin Yang authored Jan 07, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  0ada960a
06 Jan, 2026 1 commit
- [Quantization][MoE] remove unused ep logic from moe marlin (#31571) · 2f4bdee6
  Jinzhen Lin authored Jan 07, 2026
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2f4bdee6
16 Dec, 2025 2 commits

[Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
ce96857f

[Refactor] Small refactor for group topk (#30562) · f21f5ea3

Wentao Ye authored Dec 16, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f21f5ea3

12 Dec, 2025 1 commit
- gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
  Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
  6a6fc41c
11 Dec, 2025 1 commit
- [Refactor] Remove useless syncwarp (#30510) · 61249b17
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  61249b17
09 Dec, 2025 2 commits
- Lora MoE Align Improvements (#29257) · ea657f20
  gnovack authored Dec 08, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
```
  ea657f20
- [Perf] Optimize `group_topk` kernel, 1.9% Throughput improvement, 2.1% TPOT improvemnt (#30159) · 0ee6416f
  Wentao Ye authored Dec 08, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0ee6416f
07 Dec, 2025 1 commit

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

02 Dec, 2025 1 commit
- [CPU]Parallelize over tokens in int4 moe (#29600) · 13ea39bc
  Zhang Xiangze authored Dec 02, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  13ea39bc
29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

27 Nov, 2025 1 commit

[Bugfix] fix IMA issue in certain cases of the moe marlin kernel (#28619) · a67dec7c

Jinzhen Lin authored Nov 27, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a67dec7c

08 Nov, 2025 1 commit

[Perf][DeepSeek] Add sigmoid+bias fusion to fused_grouped_topk from TRTLLM (#28124) · 08525276

Michael Goin authored Nov 08, 2025

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

08525276

04 Nov, 2025 1 commit
- [CPU]Improve dynamic 4bit moe performance (#27240) · f32cbc9a
  xiangze-arm authored Nov 04, 2025
```
Signed-off-by: Zhang Xiangze <Xiangze.Zhang@arm.com>
```
  f32cbc9a
03 Nov, 2025 1 commit

Early exit for MoE LoRA kernels (#27131) · 294c805f

gnovack authored Nov 03, 2025


Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

294c805f

22 Oct, 2025 1 commit
- Bugfix - pass 'max_num_tokens_padded' into 'moe_lora_align_block_size' (#27311) · 8e4ca4d1
  gnovack authored Oct 22, 2025
```
Signed-off-by: gnovack <gnovack@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e4ca4d1
21 Oct, 2025 1 commit

[Feature][Kernel]FusedMoE LoRA (#21229) · 5f6cbf60

Chen Wu authored Oct 21, 2025


Signed-off-by: wuchen <cntryroa@gmail.com>
Signed-off-by: banjuede <lmklhc@163.com>
Signed-off-by: Chen Wu <cntryroa@gmail.com>
Signed-off-by: Danielle Robinson <dmmaddix@amazon.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Signed-off-by: bk-201 <joy25810@foxmail.com>
Co-authored-by: wuchen <wuchen@zetyun.com>
Co-authored-by: Nathan Van Gheem <vangheem@gmail.com>
Co-authored-by: banjuede <lmklhc@163.com>
Co-authored-by: Danielle Robinson <dmmaddix@amazon.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: bk-201 <joy25810@foxmail.com>

5f6cbf60

17 Oct, 2025 1 commit
- [Kernel][Performance] Fuse float cast and renormalize to topk softmax kernel (#26717) · 75c7ad99
  zhrrr authored Oct 17, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
```
  75c7ad99