Commits · f40f763f12c0ffbbc781b0ea23f4b9868db70d21 · OpenDAS / vllm_cscc

16 Jun, 2025 1 commit
- [CI] Add mteb testing for rerank models (#19344) · f40f763f
  wang.yuqi authored Jun 16, 2025
  
  f40f763f
13 Jun, 2025 2 commits
- use base version for version comparison (#19587) · ce688ad4
  Boyuan Feng authored Jun 13, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  ce688ad4
- [BugFix] : Fix Batched DeepGemm Experts (#19515) · e3b12667
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e3b12667
12 Jun, 2025 7 commits
- [Misc] Turn MOE_DP_CHUNK_SIZE into an env var (#19506) · 9d880f59
  Varun Sundar Rabindranath authored Jun 12, 2025
  
  9d880f59
- Fix TorchAOConfig skip layers (#19265) · 96846bb3
  mobicham authored Jun 12, 2025
```
Signed-off-by: mobicham <hicham@mobiuslabs.com>
```
  96846bb3
- [Quantization] Improve AWQ logic (#19431) · 73e2e011
  Jee Jee Li authored Jun 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  73e2e011
- [AMD][Kernel][BugFix] fix test_rocm_compressed_tensors_w8a8 for rocm (#19509) · 2e090bd5
  rasmith authored Jun 12, 2025
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2e090bd5
- Add Triton Fused MoE kernel config for E=16 on B200 (#19518) · 3f6341bf
  Brayden Zhong authored Jun 12, 2025
```
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  3f6341bf
- [BugFix] Force registration of w8a8_block_fp8_matmul_deepgemm via lazy import (#19514) · e5d35d62
  Varun Sundar Rabindranath authored Jun 12, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  e5d35d62
- [CI] change spell checker from codespell to typos (#18711) · 2f1c19b2
  Ning Xie authored Jun 12, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  2f1c19b2
11 Jun, 2025 4 commits
- [Kernels] Add activation chunking logic to FusedMoEModularKernel (#19168) · 29fa5cac
  bnellnm authored Jun 11, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  29fa5cac
- Fix some typo (#19475) · 3c8694ea
  Ximingwang-09 authored Jun 11, 2025
```
Signed-off-by: ximing.wxm <ximing.wxm@antgroup.com>
Co-authored-by: ximing.wxm <ximing.wxm@antgroup.com>
```
  3c8694ea
- [Kernel] Support deep_gemm for linear methods (#19085) · b8e809a0
  artetaout authored Jun 11, 2025
```
Signed-off-by: artetaout <lulala341@gmail.com>
```
  b8e809a0
- Add fused MOE config for Qwen3 30B A3B on B200 (#19455) · 2d40665f
  Junhao Li authored Jun 11, 2025
```
Signed-off-by: Junhao Li <junhao@ubicloud.com>
```
  2d40665f
10 Jun, 2025 2 commits

Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B-FP8 (#19401) · 22c3c0aa
Xu Wenqing authored Jun 11, 2025
```
Signed-off-by: 许文卿 <xwq391974@alibaba-inc.com>
```
22c3c0aa

[Misc] Slight improvement of the BNB (#19418) · b6553be1

Jee Jee Li authored Jun 10, 2025

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

b6553be1

09 Jun, 2025 1 commit
- [Misc] Fixes and Optimizations for DeepEP + DeepGEMM combination. (#19298) · 5cf2daea
  Varun Sundar Rabindranath authored Jun 09, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  5cf2daea
08 Jun, 2025 2 commits
- [Quantization] Add compressed-tensors NVFP4 support (#18312) · c123bc33
  Dipika Sikka authored Jun 08, 2025
  
  c123bc33
- Add H20-3e fused MoE kernel tuning configs for Qwen3-235B-A22B (#19315) · 989dcee9
  Xu Wenqing authored Jun 08, 2025
```
Signed-off-by: Xu Wenqing <xuwq1993@qq.com>
```
  989dcee9
07 Jun, 2025 1 commit

[Kernel] Integrate CUTLASS MoE kernel with PPLX (#18762) · 84166fee

ElizaWszola authored Jun 07, 2025


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

84166fee

06 Jun, 2025 2 commits
- [Quantization] Bump compressed-tensors version; update NVFP4A16 test model (#19224) · 94870359
  Dipika Sikka authored Jun 06, 2025
```
Signed-off-by: Dipika Sikka <dipikasikka1@gmail.com>
```
  94870359
- Fix AOPerModuleConfig name changes (#18869) · c8134bea
  Jerry Zhang authored Jun 05, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  c8134bea
05 Jun, 2025 2 commits
- [Hardware][NVIDIA] FP4 MoE kernel optimization (#19110) · 61059bee
  Chiyue Wei authored Jun 05, 2025
```
Signed-off-by: Chiyue Wei <chiyuew@nvidia.com>
Co-authored-by: Chiyue Wei <chiyuew@nvidia.com>
```
  61059bee
- Add H20-3e fused MoE kernel tuning configs for DeepSeek-R1/V3 (#19205) · ec89524f
  Xu Wenqing authored Jun 06, 2025
  
  ec89524f
04 Jun, 2025 3 commits
- [Kernel] Integrate batched/masked deepgemm kernel (#19111) · c3fd4d66
  Varun Sundar Rabindranath authored Jun 04, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun <vsundarr@redhat.com>
```
  c3fd4d66
- Sm100 blockwise fp8 swap ab (#18564) · 5f2cd251
  Lain authored Jun 04, 2025
  
  5f2cd251
- [KERNEL] Sampler. CUDA kernel for applying repetition penalty (#18437) · 5d6d1adf
  Vadim Gimpelson authored Jun 04, 2025
  
  5d6d1adf
03 Jun, 2025 3 commits
- [Kernel] DeepEP dispatch-combine kernel integration (#18434) · fa98d777
  Varun Sundar Rabindranath authored Jun 03, 2025
```
Signed-off-by: Varun <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
  fa98d777
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
- [Bugfix][EP+DP] Use pplx-kernel internode instead of intranode (#19034) · 8a57872b
  Tyler Michael Smith authored Jun 02, 2025
```
Signed-off-by: Tyler Michael Smith <tysmith@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8a57872b
31 May, 2025 2 commits
- [ROCm][Kernel] Add gfx950 support for skinny gemms (#18010) · 306d6040
  Charlie Fu authored May 31, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  306d6040
- [FEAT][ROCm] Add AITER grouped topk for DeepSeekV2 (#18825) · 0f5e0d56
  vllmellm authored May 31, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  0f5e0d56
30 May, 2025 4 commits
- [Misc] add group_size is -1 in awq quantization (#18910) · 7f21e805
  rongfu.leng authored May 31, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  7f21e805
- [Bugfix] Remove NVFP4 scales assertions to fix load_format=dummy (#18861) · 4d0a1541
  Michael Goin authored May 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  4d0a1541
- improve the robustness of parsing vlms config in AutoRound (#18894) · 3de3eadf
  Wenhua Cheng authored May 30, 2025
```
Signed-off-by: wenhuach21 <wenhua.cheng@intel.com>
```
  3de3eadf
- [Misc] Update type annotation for rotary embedding `base` (#18914) · 1aa2f81b
  Cyrus Leung authored May 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1aa2f81b
29 May, 2025 3 commits
- [TPU] remove transpose ops in moe kernel (#18923) · a1cc9f33
  Chengji Yao authored May 29, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  a1cc9f33
- [Bugfix][TPU] fix moe custom kernel import (#18853) · 8e882ffd
  Chengji Yao authored May 28, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  8e882ffd
- Prevent the cross-encoder logic from being applied to classification tasks (#18838) · 515b413e
  Maximilien de Bayser authored May 28, 2025
```
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  515b413e
28 May, 2025 1 commit

[Core] Enable CUDA graphs for DP + All2All kernels (#18724) · 7951d787

Varun Sundar Rabindranath authored May 28, 2025


Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

7951d787