Commits · f0bca83ee4b6aa6d63da66d37dd69929bdcfc1fe · OpenDAS / vllm_cscc

31 Jan, 2026 1 commit

Add support for Mistral Large 3 inference with Flashinfer MoE (#33174) · f0bca83e

Dimitrios Bariamis authored Jan 31, 2026

Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

f0bca83e

28 Jan, 2026 2 commits

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

[Quantization][Deprecation] Remove BitBlas (#32683) · 247d1a32

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

247d1a32

27 Jan, 2026 2 commits

[AMD][QWEN3-NEXT] FP8 Tunings (#32042) · da8d0c44
Lifan Shen authored Jan 27, 2026
```
Signed-off-by: Lifan Shen <lifans@meta.com>
```
da8d0c44

[MoE Refactor] Integrate Naive Prepare Finalize into MK (#32567) · 5a93b916

Robert Shaw authored Jan 26, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: amirkl94 <203507526+amirkl94@users.noreply.github.com>

5a93b916

26 Jan, 2026 1 commit
- [Refactor] Remove unused `_moe_permute` function (#33108) · 8f987883
  Wentao Ye authored Jan 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  8f987883
25 Jan, 2026 1 commit
- [Perf][Kernel] Optimize FP4 quantization kernels (SM100F) (#32520) · fcb9df99
  Roberto L. Castro authored Jan 25, 2026
```
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
```
  fcb9df99
23 Jan, 2026 2 commits
- [Refactor] Rename `gptq_marlin` to `marlin` to match MoE (#32952) · 4561f139
  Michael Goin authored Jan 23, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4561f139
- [Bug] Fix benchmark script `moe_permute_unpermute` (#32949) · dfab5f37
  Wentao Ye authored Jan 23, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  dfab5f37
22 Jan, 2026 1 commit
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
21 Jan, 2026 4 commits
- [Kernel] Add topk_sigmoid kernel (#31246) · 63227acc
  Xin Yang authored Jan 21, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  63227acc
- Add missing import of fused_topk to benchmark_moe (#32784) · f9995398
  danisereb authored Jan 21, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  f9995398
- [PluggableLayer][1/N] Define PluggableLayer (Fix ci) (#32744) · 1861ae8a
  whx authored Jan 22, 2026
```
Signed-off-by: whx-sjtu <2952154980@qq.com>
```
  1861ae8a
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
19 Jan, 2026 1 commit

[GLM-4.7] GLM Model support for GLM-Lite (#31386) · 71832ba7

Yuxuan Zhang authored Jan 19, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Yuxuan Zhang <2448370773@qq.com>

71832ba7

12 Jan, 2026 1 commit
- [cpu][bench] Add Fused MoE Micro Benchmark for CPU Backend (#32092) · 5e034f2e
  Andika Rachman authored Jan 12, 2026
```
Signed-off-by: andikarachman <andika.rachman.y@gmail.com>
```
  5e034f2e
09 Jan, 2026 1 commit
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
08 Jan, 2026 2 commits

[MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71

Robert Shaw authored Jan 07, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

9f6dcb71

[MoE Refactor][15/N] Apply Refactor to Fp8 (#31415) · 5dcd7ef1
Robert Shaw authored Jan 07, 2026

5dcd7ef1

06 Jan, 2026 3 commits
- [Misc] Use `deprecated` for `seed_everything` (#31780) · db318326
  Cyrus Leung authored Jan 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  db318326
- [cpu][bench] Add CPU paged attention benchmarks (#31720) · 799b5721
  Fadi Arafeh authored Jan 06, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  799b5721
- [Bugfix] Add init_workspace_manager to moe kernel benchmarks (#31042) · e1cd7a5f
  Michael Goin authored Jan 05, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e1cd7a5f
02 Jan, 2026 1 commit
- [Benchmark] Fix OOM during MoE kernel tuning for large models (#31604) · a0e9ee83
  Alfred authored Jan 03, 2026
```
Signed-off-by: Alfred <massif0601@gmail.com>
```
  a0e9ee83
25 Dec, 2025 1 commit

use the same stream for cuda graph catpure and replay for NCCL (#29207) · 030fc449

Amir Samani authored Dec 25, 2025


Signed-off-by: Amir Samani <asamani@nvidia.com>
Signed-off-by: youkaichao <youkaichao@gmail.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

030fc449

21 Dec, 2025 1 commit
- [NVFP4][Perf] Tune NVFP4 input quant kernel for small batch size (#30897) · 06d49028
  Michael Goin authored Dec 21, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  06d49028
16 Dec, 2025 1 commit
- [Perf][Kernels] Vectorize `csrc/activations_kernels.cu` (#29512) · 0a1ab1e5
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0a1ab1e5
11 Dec, 2025 2 commits
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) · fba89069
  Ming Yang authored Dec 11, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fba89069
07 Dec, 2025 1 commit

[Kernel][MoE] optimize `moe_align_block_size` (#29642) · 879ddb09

Jinzhen Lin authored Dec 07, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

879ddb09

03 Dec, 2025 1 commit

[Performance][DP/EP] Add silu_mul_per_token_group_quant_fp8_colmajor kernel (#29470) · 19bee6d1

Varun Sundar Rabindranath authored Dec 03, 2025

Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

19bee6d1

29 Nov, 2025 1 commit

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722) · 1656ad37

Jinzhen Lin authored Nov 29, 2025


Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: Jinzhen Lin <linjinzhen@hotmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

1656ad37

24 Nov, 2025 1 commit

[Doc]: fix typos in various files (#29230) · eca7a8fb

Didier Durand authored Nov 24, 2025

Signed-off-by: Didier Durand <durand.didier@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

eca7a8fb

19 Nov, 2025 1 commit
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
18 Nov, 2025 1 commit
- Replace `torch.cuda.Event` with `torch.Event` for better hardware compatibility (#26985) · 2a2d5d27
  Kunshang Ji authored Nov 19, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  2a2d5d27
11 Nov, 2025 2 commits
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
- Fix rotary embedding benchmark script (#28323) · 57201a6a
  Xin Yang authored Nov 10, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  57201a6a
10 Nov, 2025 2 commits

[PERF] Allreduce fusion. Support torch native matching. Tuning of the thresholds (#24248) · d17ecc6b

Ilya Markov authored Nov 11, 2025

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

d17ecc6b

[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for... · 03fa4d3f

Xiake Sun authored Nov 10, 2025


[Hardware][AMD][Model] Add Triton MoE tuning support and optimized configs for Qwen3 omni for MI308X (#28373)
Signed-off-by: Xiake Sun <xiake.sun@amd.com>
Signed-off-by: Xiake Sun <xisun@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

03fa4d3f

06 Nov, 2025 1 commit
- Disable nm-testing models with issues in CI (#28206) · f3222929
  Michael Goin authored Nov 06, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f3222929
04 Nov, 2025 1 commit
- [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) · e4ee6586
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  e4ee6586