Commits · 01923eec7092fd5b718cb9b45eb6df152abe9296 · OpenDAS / vllm_cscc

26 Feb, 2026 6 commits

[ROCm][Quantization] GPT OSS Upstream MoE wmxfp4_afp8 with static scales (#30357) · 01923eec
Aleksandr Malyshev authored Feb 26, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
01923eec

[WideEP] Remove pplx all2all backend (#33724) · eb19955c

Tyler Michael Smith authored Feb 26, 2026


Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>

eb19955c

add mixed precision support for modelopt (#35047) · d0105b84
sychen52 authored Feb 26, 2026
```
Signed-off-by: Shiyang Chen <shiychen@nvidia.com>
```
d0105b84

[ROCm] Add dynamic mxfp4 quantization for DeepSeek V2 projection layers (#34157) · ec8ab9d2

Douglas Lehr authored Feb 26, 2026

Signed-off-by: Doug Lehr <douglehr@amd.com>
Signed-off-by: Douglas Lehr <91553416+dllehr-amd@users.noreply.github.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Rohan Potdar <66227218+Rohan138@users.noreply.github.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>

ec8ab9d2

[Refactor] Remove dead or duplicate func utils or variables (#35318) · 05972ea7
Wentao Ye authored Feb 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
05972ea7
[MoE Refactor] MXFP4 Cutlass Experts to MK (#34542) · 1976356e
Yongye Zhu authored Feb 25, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
1976356e

25 Feb, 2026 1 commit
- [Platform] Add current_platform.num_compute_units interface (#35042) · 8ad54a99
  Kunshang Ji authored Feb 25, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
```
  8ad54a99
24 Feb, 2026 5 commits

Integrate flashinfer mm_mxfp8 in ModelOpt MXFP8 (#35053) · 9609b1f1
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
9609b1f1
Fix fallback to default tactic (flashinfer autotuner) with trtllm_fp4_block_scale_moe (#35088) · a0c70816
danisereb authored Feb 24, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
a0c70816

[Attn,KV-cache] Use per-head scales in the attention selector (#34281) · a87cc508

Eldar Kurtić authored Feb 24, 2026


Signed-off-by: Your Name <you@example.com>
Signed-off-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Eldar Kurtic <research@neuralmagic.com>
Co-authored-by: Your Name <you@example.com>

a87cc508

[Refactor] [1/N] Reorganize kernel abstraction directory (#34055) · 6af03f23

BadrBasowid authored Feb 24, 2026


Signed-off-by: BadrBasowid <badr.basowid@gmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>

6af03f23

[Quantization] Support FP8 MoE bias for models like GPT-OSS (#34906) · ec853405

Jia Guo authored Feb 23, 2026


Signed-off-by: jasperjiaguo <jasperg662@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

ec853405

23 Feb, 2026 1 commit
- [kv-cache, ct] Use compressed-tensors as a source of ground-truth for quant strategies (#34254) · b95bb692
  Eldar Kurtić authored Feb 23, 2026
```
Signed-off-by: Your Name <you@example.com>
Co-authored-by: Your Name <you@example.com>
```
  b95bb692
22 Feb, 2026 1 commit

[Model] Add NVFP4 quantization support for Step3.5-Flash (#34478) · b7892a3b

tacos8me authored Feb 22, 2026


Signed-off-by: tacos8me <ian@cloudhabit.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

b7892a3b

21 Feb, 2026 1 commit
- [ROCm] Enable bitsandbytes quantization support on ROCm (#34688) · 8dc8a99b
  BADAOUI Abdennacer authored Feb 21, 2026
```
Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>
```
  8dc8a99b
20 Feb, 2026 2 commits

[Minor] Add logging when using MXFP4 MXFP8 TRTLLM backend (#34916) · 05977923

Frank Wang authored Feb 19, 2026

Signed-off-by: frankwang28 <frank.wbb@hotmail.com>
Signed-off-by: Frank Wang <41319051+frankwang28@users.noreply.github.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

05977923

[Quark] Fix MoE fp8 activation scale handling on mi300 (#34386) · d9e62c03
Bowen Bao authored Feb 19, 2026
```
Signed-off-by: Bowen Bao <bowenbao@amd.com>
```
d9e62c03

19 Feb, 2026 2 commits
- [UX] More descriptive reasons in is_supported_config for MoE (#34908) · f72061a1
  Michael Goin authored Feb 19, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f72061a1
- [Bugfix] Fix cutlass fp8 kernel on hopper for Qwen3.5 (#34914) · 4fb8beef
  Roger Wang authored Feb 19, 2026
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  4fb8beef
18 Feb, 2026 4 commits
- [MoE Refactor] Convert mxfp4 marlin into modular kernel format (#34588) · 40da9625
  Yongye Zhu authored Feb 18, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  40da9625
- [Bugfix] Fix NVFP4 TRTLLM MoE non-gated support; add gsm8k for Nemotron-3-Nano FP8+NVFP4 (#34725) · caeb887b
  Michael Goin authored Feb 18, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  caeb887b
- [Quantization] - Added uses_meta_device_weights to quant config (#34645) · 1faa8cb7
  Asaf Joseph Gardin authored Feb 18, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  1faa8cb7
- [Bugfix] Fix quant RMS norm fusion for quantization with TMA-aligned scales (#33255) · a88b3be7
  ElizaWszola authored Feb 18, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  a88b3be7
17 Feb, 2026 1 commit
- Remove dead bitsandbytes CxB code from 8-bit inference path (#34633) · d44a5b6c
  Tim Dettmers authored Feb 17, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  d44a5b6c
16 Feb, 2026 2 commits
- Fix call to moe_mk in modelopt MoE modules (required for LoRA) (#34575) · ec7d9e67
  danisereb authored Feb 16, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  ec7d9e67
- [Bugfix] Fix Dynamo unexpected keyword argument (#34320) · a5ccc85c
  Samu Tamminen authored Feb 16, 2026
```
Signed-off-by: Samu Tamminen <stammine@amd.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  a5ccc85c
12 Feb, 2026 5 commits

[Kernel] Support Flashinfer trtllm fused MoE non gated FP8 & NVFP4 (#33506) · f120bd42
amitz-nv authored Feb 12, 2026
```
Signed-off-by: amitz-nv <203509407+amitz-nv@users.noreply.github.com>
```
f120bd42
[ROCm][quantization] improve OCP weight quant parser robust (#34431) · 766e1678
xuebwang-amd authored Feb 13, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
766e1678

[ROCm] Enable MXFP4 MoE weight pre-shuffling on gfx950 and update aiter (#34192) · 8a798be9

Douglas Lehr authored Feb 12, 2026


Signed-off-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Doug Lehr <douglehr@amd.com>
Co-authored-by: Gregory Shtrasberg <156009573+gshtras@users.noreply.github.com>
Co-authored-by: tjtanaavllm <tunjian.tan@amd.com>

8a798be9

[Bugfix] Fix Sparse24 Compressed Tensors models (#33446) · e9cd6911
Kyle Sayers authored Feb 12, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
e9cd6911
[Refactor] Replace `activation: str` with `MoEActivation` enum (#33843) · ff1f83b0
Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
ff1f83b0

11 Feb, 2026 5 commits
- [Docs] Reduce time spent generating API docs (#34255) · 40b8f553
  Harry Mellor authored Feb 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  40b8f553
- [XPU][9/N] clean up existing ipex code/doc (#34111) · cb9574eb
  Kunshang Ji authored Feb 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  cb9574eb
- [ModelBash][DSR1 NVFp4] Removed Bf16 Bias Cast (#34298) · 9b17c574
  Robert Shaw authored Feb 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9b17c574
- [WideEP] Fix nvfp4 DeepEP High Throughput All2All backend (#33738) · 066c6da6
  Tyler Michael Smith authored Feb 10, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  066c6da6
- [MoE Refactor] Introduce MoERunner abstraction and move execution logic from... · d1481ba7
  bnellnm authored Feb 10, 2026
```
[MoE Refactor] Introduce MoERunner abstraction and move execution logic from FusedMoE to DefaultMoERunner (#32344)
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  d1481ba7
10 Feb, 2026 1 commit

[ROCm][Quantization] GPT_OSS in amd-quark format model loading and emulations (#29008) · b129136c

xuebwang-amd authored Feb 10, 2026


Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

b129136c

09 Feb, 2026 2 commits
- [Bugfix] Fix shared expert input for latent MoE in EP+DP (Nemotron-H) (#34087) · 995bbf38
  TomerBN-Nvidia authored Feb 09, 2026
```
Signed-off-by: Tomer Natan <tbarnatan@nvidia.com>
Co-authored-by: Cursor <cursoragent@cursor.com>
```
  995bbf38
- [XPU][6/N] add xpu scaled_mm kernel (#34117) · 9bdb06b4
  zofia authored Feb 09, 2026
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
```
  9bdb06b4
08 Feb, 2026 1 commit
- Add support for ModelOpt MXFP8 dense models (#33786) · 084aa19f
  danisereb authored Feb 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  084aa19f