Commits · 8e6c7e873f1a2830ab096d69ee1812b323aef650 · OpenDAS / vllm_cscc

06 Aug, 2025 1 commit
- [Bugfix] Fix MoE BNB version (#22260) · 8e6c7e87
  Jee Jee Li authored Aug 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8e6c7e87
02 Aug, 2025 1 commit
- feat: Add Support GPTQ Quantization MOE on ROCM vllm serve (#21733) · 3654847d
  JartX authored Aug 02, 2025
  
  3654847d
31 Jul, 2025 2 commits
- [Feature] Add Flashinfer MoE Support for Compressed Tensor NVFP4 (#21639) · c3e0e933
  Wentao Ye authored Jul 31, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c3e0e933
- [NVIDIA] Add SM100 Flashinfer MoE per tensor scale fp8 backend (#21458) · 207b750e
  amirkl94 authored Jul 31, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  207b750e
30 Jul, 2025 1 commit
- [NVIDIA] Fix Llama4 Scout FP4 functionality issues (#21499) · ff08e519
  Po-Han Huang (NVIDIA) authored Jul 30, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
  ff08e519
29 Jul, 2025 2 commits
- [Bugfix]fix mixed bits and visual language model quantization in AutoRound (#21802) · ad341c51
  Wenhua Cheng authored Jul 29, 2025
```
Signed-off-by: Wenhua Cheng <wenhua.cheng@intel.com>
```
  ad341c51
- [Refactor] Merge Compressed Tensor FP8 `CompressedTensorsW8A8Fp8MoEMethod` and... · 48b763d6
  Wentao Ye authored Jul 28, 2025
```
[Refactor] Merge Compressed Tensor FP8 `CompressedTensorsW8A8Fp8MoEMethod` and `CompressedTensorsW8A8Fp8MoECutlassMethod` (#21775)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  48b763d6
28 Jul, 2025 2 commits
- [Feat]: Add support for Dynamic Quant 4 bit CPU kleidiai kernels (#17112) · 89ac266b
  Nikhil Gupta authored Jul 28, 2025
```
Signed-off-by: Nikhil Gupta <nikhil.gupta2@arm.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  89ac266b
- [FEAT] [ROCm] [AITER]: Add AITER HIP block quant kernel (#21242) · e626d286
  TJian authored Jul 27, 2025
  
  e626d286
27 Jul, 2025 1 commit
- [Refactor] Refactor MOE NVFP4 Code Base: ModelOpt + Compressed Tensor (#21631) · bda9d053
  Wentao Ye authored Jul 27, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bda9d053
26 Jul, 2025 2 commits
- [Feature] Add support for MoE models in the calibration-free RTN-based quantization (#20766) · 7ae75fa6
  Alex Kogan authored Jul 25, 2025
```
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
```
  7ae75fa6
- [Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476) · 75d29cf4
  Wentao Ye authored Jul 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  75d29cf4
25 Jul, 2025 1 commit
- [Bug] Fix DeepGemm Init Error (#21554) · 633f6e80
  Wentao Ye authored Jul 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  633f6e80
24 Jul, 2025 1 commit
- Update flashinfer CUTLASS MoE Kernel (#21408) · 1b25f1fe
  Shu Wang authored Jul 24, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  1b25f1fe
22 Jul, 2025 4 commits
- [Perf] Cuda Kernel for Per Token Group Quant (#21083) · 774d0c01
  Wentao Ye authored Jul 22, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  774d0c01
- [feat]: add SM100 support for cutlass FP8 groupGEMM (#20447) · 2c8db17c
  Duncan Moss authored Jul 22, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  2c8db17c
- [perf] Add fused MLA QKV + strided layernorm (#21116) · 4fb56914
  Mickaël Seznec authored Jul 22, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  4fb56914
- Revert "[Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) (#21334) · e7b20426
  Ming Yang authored Jul 21, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  e7b20426
21 Jul, 2025 1 commit
- Add Nvidia ModelOpt config adaptation (#19815) · 6b46c4b6
  Zhiyu authored Jul 21, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  6b46c4b6
19 Jul, 2025 1 commit

[NVIDIA] Add SM100 Flashinfer MoE blockscale fp8 backend for low latency (#20645) · 6d0734c5

Kaixi Hou authored Jul 19, 2025


Signed-off-by: kaixih <kaixih@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

6d0734c5

18 Jul, 2025 1 commit

[Core] FlashInfer CUTLASS fused MoE backend (NVFP4) (#20037) · c7d8724e

Shu Wang authored Jul 17, 2025


Signed-off-by: shuw <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

c7d8724e

17 Jul, 2025 2 commits
- [Performance] Performance improvements in non-blockwise fp8 CUTLASS MoE (#20762) · 9fb2d220
  ElizaWszola authored Jul 17, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  9fb2d220
- [Bugfix] Fix Machete zero point issue for GPTQ models on SM90 (#21066) · 28a6d542
  Michael Goin authored Jul 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  28a6d542
16 Jul, 2025 3 commits

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC... · 01513a33

Nir David authored Jul 16, 2025


Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

01513a33

[Doc] Remove duplicate docstring (#21012) · 76ddeff2
Wentao Ye authored Jul 15, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
76ddeff2
[Bugfix] Correct per_act_token in CompressedTensorsW8A8Fp8MoECutlassM… (#20937) · fcb9f879
Ming Yang authored Jul 15, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
fcb9f879

15 Jul, 2025 3 commits
- Enabled BnB NF4 inference on Gaudi (#20172) · 016b8d1b
  Ruheena Suhani Shaik authored Jul 15, 2025
```
Signed-off-by: Ruheena Suhani Shaik <rsshaik@habana.ai>
```
  016b8d1b
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
- [Bugfix] Fix incorrect dispatch for CutlassBlockScaledGroupedGemm and DeepGEMM (#20933) · bcdfb2a3
  Michael Goin authored Jul 15, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  bcdfb2a3
13 Jul, 2025 3 commits
- [V1] [ROCm] [AITER] Upgrade AITER to commit `916bf3c` and bugfix APIs (#20880) · 80d38b8a
  TJian authored Jul 13, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  80d38b8a
- [Bugfix] Fix a couple PPLX+CUTLASS MoE bugs (#20825) · 3b3b778d
  ElizaWszola authored Jul 13, 2025
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
```
  3b3b778d
- [Perf] Use Triton instead of Torch for DeepGEMM Per Token Group Quant (#20841) · 42d440c2
  Wentao Ye authored Jul 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  42d440c2
12 Jul, 2025 3 commits
- [Bugfix] Restrict Machete to only run on Hopper (#20830) · 6e2c176e
  Michael Goin authored Jul 13, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  6e2c176e
- Enable ModelOpt Llama4 fp8 checkpoint deployment (#20419) · 4afe687a
  Zhiyu authored Jul 11, 2025
```
Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>
```
  4afe687a
- [Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break... · b1235c3e
  Li, Jiang authored Jul 12, 2025
```
[Bugfix] Lazy import fused_experts in BitsAndBytesMoEMethod to avoid break not-cuda-alike devices  (#20822)
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  b1235c3e
11 Jul, 2025 3 commits
- [Quantization][1/N] MoE support BNB-Inflight Quantization (#20061) · 8020e98c
  Jee Jee Li authored Jul 11, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  8020e98c
- [Perf][fp8] Use CustomOp abstraction for fp8 quant for better perf (#19830) · 31d5c179
  Luka Govedič authored Jul 11, 2025
```
Signed-off-by: Luka Govedic <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  31d5c179
- [Feature] Integrate SM100 DeepGEMM support (#20087) · e2de455c
  Wentao Ye authored Jul 10, 2025
  
  e2de455c
09 Jul, 2025 2 commits

[Feature][Quantization] MXFP4 support for MOE models (#17888) · 332d4cb1

fxmarty-amd authored Jul 09, 2025


Signed-off-by: Felix Marty <felmarty@amd.com>
Signed-off-by: Bowen Bao <bowenbao@amd.com>
Signed-off-by: Felix Marty <Felix.Marty@amd.com>
Co-authored-by: Bowen Bao <bowenbao@amd.com>

332d4cb1

[Kernel] Add Conch backend for mixed-precision linear layer (#19818) · bf03ff35
Jacob Manning authored Jul 09, 2025
```
Signed-off-by: Jacob Manning <jmanning+oss@stackav.com>
```
bf03ff35