Commits · fc56f4a0714bd1727ea100a9d75d18ce1a138684 · OpenDAS / vllm_cscc

22 Jan, 2026 3 commits
- [Perf] Create TMA-aligned input scale tensor for DeepGemm on Hopper (#32619) · d08b356e
  Xin Yang authored Jan 22, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d08b356e
- Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3
  Eldar Kurtić authored Jan 22, 2026
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  44f08af3
- [Bugfix][Attention] Explicitly report support for kv_cache_dtype bfloat16 (#32795) · 955b43a5
  Matthew Bonanni authored Jan 22, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  955b43a5
21 Jan, 2026 5 commits
- Bump Flashinfer to v0.6.1 (#30993) · 808d6fd7
  elvischenv authored Jan 22, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  808d6fd7
- [Quantization][Deprecation] Remove RTN (#32697) · 4e31b7f2
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  4e31b7f2
- [Quantization][Deprecation] Deprecate HQQ (#32681) · 85f55c94
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  85f55c94
- [Quantization][Deprecation] Remove `DeepSpeedFp8` (#32679) · cea3c754
  Robert Shaw authored Jan 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  cea3c754
- [MoE Refactor] Oracle Select FP8+NVFP4 Kernels In Priority (#32414) · 42135d68
  Robert Shaw authored Jan 21, 2026
  
  42135d68
20 Jan, 2026 3 commits
- fp8 online quant: split out Fp8OnlineLinearMethod (#32189) · d2389c12
  Vasiliy Kuznetsov authored Jan 20, 2026
  
  d2389c12
- [Bugfix] Suppress log on non-ROCm platform (#32703) · 9b67338b
  TJian authored Jan 21, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  9b67338b
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea
19 Jan, 2026 1 commit

[BugFix] Fix TRT-LLM NVFP4 DP/EP (#32349) · 73503317

jiahanc authored Jan 19, 2026


Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

73503317

18 Jan, 2026 2 commits
- [MoE Refactor] Separate Router into OO Classes (#30623) · 327a02d8
  bnellnm authored Jan 18, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  327a02d8
- "refactor: refactor_repeated_interfaces" (#32486) · 2f03035a
  tjp_zju authored Jan 18, 2026
```
Signed-off-by: tom-zju <tanjianpingzju1990@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  2f03035a
16 Jan, 2026 3 commits

[CI] Fix LM Eval Large Models (H100) (#32423) · bcf2333c
Matthew Bonanni authored Jan 15, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
bcf2333c
Add thread_n=64 support to Marlin MoE (#32360) · 83239ff1
Michael Goin authored Jan 15, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
83239ff1

[Feat] Support non-gated MoE with Marlin, NVFP4 CUTLASS, FP8, INT8, compressed-tensors (#32257) · c277fbdf

TomerBN-Nvidia authored Jan 16, 2026


Signed-off-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@computelab-frontend-8.nvidia.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Tomer Natan <tbarnatan@ipp1-1429.ipp1a1.colossus.nvidia.com>

c277fbdf

15 Jan, 2026 6 commits

[ROCM] DSfp4 mla projection gemms weight dynamic quantization (#32238) · 8c11001b
Aleksandr Malyshev authored Jan 15, 2026
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
8c11001b

[BugFix] Fix `assert x_s.shape[-1] == x_q.shape[-1] // group_shape[1]` in... · c36ba69b

Lucas Wilkinson authored Jan 15, 2026


[BugFix] Fix `assert x_s.shape[-1] == x_q.shape[-1] // group_shape[1]` in Blackwell Quantized MoE Test (#32362)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

c36ba69b

[Quant] Support MXFP4 W4A16 for compressed-tensors MoE models (#32285) · 361dfdc9
Dipika Sikka authored Jan 15, 2026
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
361dfdc9
[ROCm] Improve error handling while loading quantized model on gfx120… (#31715) · b89275d0
brian033 authored Jan 15, 2026
```
Signed-off-by: brian033 <85883730+brian033@users.noreply.github.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
b89275d0

[BugFix] Fix DeepSeek-V3.1 + DeepGEMM incompatible scale shapes (#32361) · 2c9b4cf5

Lucas Wilkinson authored Jan 14, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Eldar Kurtić <8884008+eldarkurtic@users.noreply.github.com>

2c9b4cf5

[CI][AMD][Quantization][BugFix] Fix fp8 max in quant_utils.py and update... · 3c268564

rasmith authored Jan 14, 2026


[CI][AMD][Quantization][BugFix] Fix fp8 max in quant_utils.py and update test_fp8_quant.::test_static_fp8_quant_group_2d to use correct fp8 dtype and adjust atol/rtol (#32201)
Signed-off-by: Randall Smith <ransmith@amd.com>

3c268564

14 Jan, 2026 2 commits
- [Docs] Add docs about OOT Quantization Plugins (#32035) · 6388b500
  Michael Goin authored Jan 14, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6388b500
- Consolidate Intel Quantization Toolkit Integration in vLLM (#31716) · 50632adc
  Yi Liu authored Jan 14, 2026
```
Signed-off-by: yiliu30 <yi4.liu@intel.com>
```
  50632adc
13 Jan, 2026 2 commits

[Kernel][Performance] Enable smaller Scaling Factor tiling for NVFP4 small-batch decoding (#30885) · 8ef50d9a

Roberto L. Castro authored Jan 14, 2026

Signed-off-by: LopezCastroRoberto <roberto.lopez.castro@udc.es>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>

8ef50d9a

[Quantization] fix: overflow with static per-tensor scaling (#29867) · a5bbbd2f

Mickaël Seznec authored Jan 13, 2026


Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

a5bbbd2f

11 Jan, 2026 1 commit
- [Hardware][AMD][CI][Bugfix] Fix AMD Quantization test group (#31713) · bde57ab2
  Matt authored Jan 11, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  bde57ab2
10 Jan, 2026 2 commits
- [Bugfix][Quantization] Ensure input contiguity in per_token_quant_int8 (#31637) · 6ea001cf
  Vensen authored Jan 11, 2026
```
Signed-off-by: vensen <vensenmu@gmail.com>
```
  6ea001cf
- [Quant] Support MXFP4 W4A16 for compressed-tensors dense models (#31926) · e6c6f2c7
  Michael Goin authored Jan 10, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  e6c6f2c7
09 Jan, 2026 6 commits

[Quant] Make static quant support all group shapes (#30833) · 0a0aa077
Lucas Wilkinson authored Jan 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
0a0aa077
[fix] add cutedsl to global sf (#32001) · f9e2a75a
jiahanc authored Jan 09, 2026
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
f9e2a75a
[Doc] Add developer guide for CustomOp (#30886) · 08d954f0
Shanshan Shen authored Jan 10, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
08d954f0

[Bugfix] Fix Typo from NVFP4 Refactor (#31977) · 0fa8dd24

Robert Shaw authored Jan 08, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

0fa8dd24

[Quantization] Deprecate Long Tail of Schemes (#31688) · 5825bbc1

Robert Shaw authored Jan 08, 2026

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5825bbc1

[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change... · d62cfe54

Yongye Zhu authored Jan 08, 2026


[MoE Refactoring][Bugfix]Wrap WNA16 Triton kernel into mk and change compressed tensor kernel selection (#31752)
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d62cfe54

08 Jan, 2026 4 commits
- [Compressed-Tensors] Simplify NVFP4 Conditions, enable marlin support for NVFP4A16 MoEs (#30881) · 5d3b6097
  Dipika Sikka authored Jan 08, 2026
  
  5d3b6097
- [Misc][Refactor] Add FusedMoERouter object (#30519) · e74698c2
  bnellnm authored Jan 08, 2026
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  e74698c2
- [Bugfix] Fix vllm serve failure with Nemotron Nano V3 FP8 (#31960) · b8112c1d
  danisereb authored Jan 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  b8112c1d
- [MoE Refactor][16/N] Apply Refactor to NVFP4 (#31692) · 9f6dcb71
  Robert Shaw authored Jan 07, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  9f6dcb71