Commits · ed0622e3a809fe399b81009c9dbb9cf7299414e6 · OpenDAS / vllm_cscc

18 Apr, 2026 1 commit
- [Attention] TurboQuant: remove redundant random signs, add prior art attribution (#40194) · ed0622e3
  Dan Alistarh authored Apr 18, 2026
```
Signed-off-by: Dan Alistarh <d.alistarh@gmail.com>
```
  ed0622e3
17 Apr, 2026 1 commit

skip fp8e4b15 on xpu (#39957) · 251c18d1

Xinyu Chen authored Apr 18, 2026


Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

251c18d1

16 Apr, 2026 1 commit
- [Quantization] Consolidate experts_int8 with fp8 online quantization (#38463) · ad2b1277
  Asaf Gardin authored Apr 16, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  ad2b1277
15 Apr, 2026 3 commits

[Quantization][Autoround][CPU] Add W4A16 Support (#38192) · 60995c05

Zhenzhong Xu authored Apr 15, 2026


Signed-off-by: Zhenzhong1 <zhenzhong.xu@intel.com>
Signed-off-by: Zhenzhong Xu <zhenzhong.xu@intel.com>

60995c05

[Test] Refactor hard coded device string in test files under... · 3abf8584

wliao2 authored Apr 14, 2026


[Test] Refactor hard coded device string in test files under compile/quantization/models/model_executor folders (#38901)
Signed-off-by: Liao, Wei <wei.liao@intel.com>

3abf8584

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

14 Apr, 2026 1 commit

[Kernel] Support TRTLLM GEN NVFP4 MoE for non-512-aligned hidden dims via weight padding (#39510) · 240f2636

danielafrimi authored Apr 14, 2026


Signed-off-by: root <root@lyris0017.lyris.clusters.nvidia.com>
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
Co-authored-by: root <root@lyris0017.lyris.clusters.nvidia.com>

240f2636

11 Apr, 2026 1 commit
- [Quant] add CompressedTensorsW8A8Mxfp8 for linear and MoE layers (#38815) · df1e30e7
  EdalatiAli authored Apr 11, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
```
  df1e30e7
09 Apr, 2026 2 commits

[Quantization] Support Quark W8A8 INT8 MoE inference (#36320) · 827268e9
PikaPikachu authored Apr 10, 2026
```
Signed-off-by: kangletian <Letian.Kang@amd.com>
```
827268e9

[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8... · 2e9034c9

Maral authored Apr 09, 2026


[W8A8 Block Linear Refactor][2/N] Remove W8A8Fp8BlockLinearOp and adopt Fp8 block linear kernel selections. (#33892)
Signed-off-by: maral <maralbahari.98@gmail.com>
Signed-off-by: Maral <maralbahari.98@gmail.com>

2e9034c9

06 Apr, 2026 1 commit

[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on... · 00d7b497

fxmarty-amd authored Apr 07, 2026


[NVFP4] Support NVFP4 dense models from `modelopt` and `compressed-tensors` on AMD Instinct MI300, MI355X and Hopper through emulation (#35733)
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Signed-off-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Kyle Sayers <kylesayrs@gmail.com>

00d7b497

03 Apr, 2026 1 commit
- [Frontend] new online quantization frontend (#38138) · 7b1a7423
  Vasiliy Kuznetsov authored Apr 03, 2026
```
Signed-off-by: Vasiliy Kuznetsov <vasiliy@meta.com>
```
  7b1a7423
02 Apr, 2026 1 commit

[Feature] KV cache per-token-head INT8/FP8 quantization (#38378) · 2ce3d0ce

JartX authored Apr 02, 2026


Signed-off-by: JartX <sagformas@epdcenter.es>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: yangyang4991 <yangyang4991@gmail.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2ce3d0ce

31 Mar, 2026 1 commit

[MoE Refactor] Migrate Unquantized to Full Oracle Flow (#36286) · d9b90a07

yzong-rh authored Mar 31, 2026


Signed-off-by: Yifan Zong <yzong@redhat.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: yzong-rh <yzong@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

d9b90a07

30 Mar, 2026 2 commits
- [ROCm][Bugfix] fix exception related to trust_remote_code for MiniMax-M2.1-MXFP4 (#37698) · dbdd9ae0
  Hongxia Yang authored Mar 30, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  dbdd9ae0
- [Bugfix] Handle ParallelLMHead in compressed-tensors get_quant_method (#37291) · e8b055a5
  Matthias Gehre authored Mar 30, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  e8b055a5
27 Mar, 2026 2 commits
- enable skipping of SW attention layers when using FP8 KV cache (#33695) · 98e7f223
  Jonas M. Kübler authored Mar 27, 2026
```
Signed-off-by: Jonas Kuebler <kuebj@amazon.com>
```
  98e7f223
- [CPU] Support CT W4A16 on CPU MP kernel (#38219) · becaed6e
  Li, Jiang authored Mar 27, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  becaed6e
23 Mar, 2026 1 commit
- [Sparse24] [Deprecation] Remove Sparse24 CT integration and kernels (#36799) · 38364a7e
  Kyle Sayers authored Mar 23, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  38364a7e
21 Mar, 2026 1 commit

[Quantization][Deprecation] Remove PTPC FP8 (#32700) · eeee5b26

Robert Shaw authored Mar 21, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

eeee5b26

19 Mar, 2026 1 commit
- [ROCm][CI] Cleaning and restructuring amd-ci legacy pipeline (#34839) · 040a505f
  Andreas Karatzas authored Mar 19, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  040a505f
12 Mar, 2026 1 commit
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
10 Mar, 2026 1 commit
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
66a22096

03 Mar, 2026 1 commit

[MoE Refactor] Create MK for TRTLLM Kernels (#32564) · 97995f63

Robert Shaw authored Mar 03, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Robert Shaw <rshaw@neuralmagic.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <rshaw@neuralmagic.com>

97995f63

02 Mar, 2026 2 commits
- [ROCm] add amd-quark package in requirements for rocm to use quantized models (#35658) · f26650d6
  Hongxia Yang authored Mar 02, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  f26650d6
- Fix deprecated v1 config tests (#35327) · a60985b0
  Jesse Cai authored Mar 01, 2026
```
Signed-off-by: Jesse Cai <jessecai@fb.com>
```
  a60985b0
26 Feb, 2026 1 commit

[UX] Add `--moe-backend` arg for explicit kernel selection (#33807) · de527e1c

Michael Goin authored Feb 25, 2026


Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

de527e1c

20 Feb, 2026 1 commit
- [Bugfix] Add regression test for MoE quant_config under torch.compile (#34335) · 4e2c7caf
  Matthias Gehre authored Feb 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  4e2c7caf
11 Feb, 2026 2 commits
- [NVIDIA][test] Tests for flashinfer TRTLLM BF16 MoE (#33715) · 275e0d2a
  Linda authored Feb 11, 2026
```
Signed-off-by: Linda-Stadter <57756729+Linda-Stadter@users.noreply.github.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>
```
  275e0d2a
- [XPU][9/N] clean up existing ipex code/doc (#34111) · cb9574eb
  Kunshang Ji authored Feb 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  cb9574eb
02 Feb, 2026 1 commit
- fix memory for online fp8 quantization with streaming weight load (#31914) · 0130223b
  Vasiliy Kuznetsov authored Feb 02, 2026
```
Signed-off-by: vasiliy <vasiliy@fb.com>
```
  0130223b
31 Jan, 2026 1 commit
- Refactor NVFP4 Linear utils for ModelOpt and CT (#33201) · 67ebaff5
  Michael Goin authored Jan 30, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  67ebaff5
30 Jan, 2026 1 commit
- [QeRL] Layerwise Reloading (#32133) · f857a03f
  Kyle Sayers authored Jan 30, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  f857a03f
28 Jan, 2026 1 commit

[Quantization][Deprecation] Remove Marlin 24 (#32688) · af9b69f9

Robert Shaw authored Jan 28, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

af9b69f9

22 Jan, 2026 1 commit

Add llmcompressor fp8 kv-cache quant (per-tensor and per-attn_head) (#30141) · 44f08af3

Eldar Kurtić authored Jan 22, 2026


Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
Signed-off-by: eldarkurtic <8884008+eldarkurtic@users.noreply.github.com>

44f08af3

21 Jan, 2026 1 commit

[Quantization][Deprecation] Remove RTN (#32697) · 4e31b7f2

Robert Shaw authored Jan 21, 2026


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

4e31b7f2

20 Jan, 2026 2 commits
- fp8 online quant: split out Fp8OnlineLinearMethod (#32189) · d2389c12
  Vasiliy Kuznetsov authored Jan 20, 2026
  
  d2389c12
- [Refactor] Make FP8 Linear Ops use kernel abstraction (#27814) · 148117ea
  vllmellm authored Jan 20, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  148117ea