Commits · 9965c47d0d072a74252878ec3c9963a540e9a690 · OpenDAS / vllm_cscc

02 Jul, 2025 2 commits

[Kernels] MoE refactor (#19636) · c1909e7e

bnellnm authored Jul 02, 2025


Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>

c1909e7e

Enable group size 64 for Machete (#20290) · 3abfe221
czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
3abfe221

01 Jul, 2025 4 commits
- [V1] [ROCm] Enable EP with AITER Fused MoE (#20270) · 02cabff2
  TJian authored Jul 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  02cabff2
- [Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
  Kyle Sayers authored Jul 01, 2025
  
  9025a9a7
- Enable ZP Support for Machete (#20268) · 9909726d
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  9909726d
- [Feature] A calibration-free RTN-based quantization for accurate and... · 27949354
  Alex Kogan authored Jul 01, 2025
```
[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  27949354
30 Jun, 2025 1 commit

[Bugfix] fix quark ptpc (#20251) · 1c50e100

li haoyang authored Jun 30, 2025


Signed-off-by: Haoyang Li <Haoyang.Li@amd.com>
Co-authored-by: Haoyang Li <307790822@qq.com>

1c50e100

29 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 MoE Support (#19990) · 6f2f53a8
  Dipika Sikka authored Jun 30, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  6f2f53a8
28 Jun, 2025 1 commit

[Refactor] Create a function util and cache the results for `has_deepgemm`,... · 4d366936

Wentao Ye authored Jun 28, 2025


[Refactor] Create a function util and cache the results for `has_deepgemm`, `has_deepep`, `has_pplx` (#20187)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

4d366936

26 Jun, 2025 2 commits
- [Feature] Expert Parallelism Load Balancer (EPLB) (#18343) · e9fd658a
  Bowen Wang authored Jun 26, 2025
```
Signed-off-by: Bowen Wang <abmfy@icloud.com>
```
  e9fd658a
- [CPU] Fix torch version in x86 CPU backend (#19258) · 0567c824
  Li, Jiang authored Jun 26, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0567c824
25 Jun, 2025 3 commits
- [Quantization] Add compressed-tensors emulations support for NVFP4 (#19879) · 02c97d9a
  Dipika Sikka authored Jun 25, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
Signed-off-by: Dipika <dipikasikka1@gmail.com>
```
  02c97d9a
- [Refactor] Remove duplicate `ceil_div` (#20023) · 879f69be
  Wentao Ye authored Jun 25, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  879f69be
- Revert "[Feature] Integrate new deepgemm (#19820)" (#20049) · a6c4b87f
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  a6c4b87f
24 Jun, 2025 2 commits
- use .dev for version comparison with pytorch nightly release (#20031) · c01d1c5a
  Boyuan Feng authored Jun 24, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c01d1c5a
- [Feature] Integrate new deepgemm (#19820) · c6e3bba8
  Wentao Ye authored Jun 24, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c6e3bba8
23 Jun, 2025 1 commit
- Feat Dynamic Quantization for MoE Layers in GPTQ Marlin Backend (#19395) · dd2ccf8d
  Jun-Howie authored Jun 24, 2025
  
  dd2ccf8d
16 Jun, 2025 2 commits
- [Quantization] Remove FP4 emulation; Fall-back to marlin for device < 100 (#19563) · 6bc7b573
  Dipika Sikka authored Jun 16, 2025
  
  6bc7b573
- [Kernel] GGUF MMVQ kernel for multiple input vectors (#18754) · dec66d25
  Szymon Ożóg authored Jun 16, 2025
```
Signed-off-by: SzymonOzog <szymon.ozog@gmail.com>
```
  dec66d25
13 Jun, 2025 1 commit
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
12 Jun, 2025 5 commits
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3
- [Quantization] Improve AWQ logic (#19431) · 73e2e011
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73e2e011
- [AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509) · 2e090bd5
  rasmith authored Jun 12, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2e090bd5
- [BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import (#19514) · e5d35d62
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e5d35d62
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 2 commits
- [Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168) · 29fa5cac
  bnellnm authored Jun 11, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  29fa5cac
- [Kernel] Support deep_gemm for linear methods (#19085) · b8e809a0
  artetaout authored Jun 11, 2025
```
Signed-off-by: artetaout <lulala341@gmail.com>
```
  b8e809a0
10 Jun, 2025 1 commit

[Misc] Slight improvement of the BNB (#19418) · b6553be1

Jee Jee Li authored Jun 10, 2025

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b6553be1

09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
08 Jun, 2025 1 commit
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

06 Jun, 2025 2 commits
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea
04 Jun, 2025 2 commits
- [Kernel] Integrate batched/masked deepgemm kernel (#19111) · c3fd4d66
  Varun Sundar Rabindranath authored Jun 04, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  c3fd4d66
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
03 Jun, 2025 2 commits
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [ROCm][Kernel] Add gfx950 support for skinny gemms (#18010) · 306d6040
  Charlie Fu authored May 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  306d6040
30 May, 2025 2 commits
- [Misc] add group_size is -1 in awq quantization (#18910) · 7f21e805
  rongfu.leng authored May 31, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  7f21e805
- [Bugfix] Remove NVFP4 scales assertions to fix load_format=dummy (#18861) · 4d0a1541
  Michael Goin authored May 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4d0a1541