Commits · 9820d063c3442ae655ff02da5f8a053befc8b0b3 · OpenDAS / vllm_cscc

30 Jul, 2025 1 commit
- 解决v1cudagraph的问题以及接入fuse moe marlin_V3版本 · 9820d063
  yangql authored Jul 30, 2025
  
  9820d063
26 Jul, 2025 1 commit
- 增加moe awq-marlin的支持 · c2bcb0ab
  yangql authored Jul 26, 2025
  
  c2bcb0ab
25 Jul, 2025 2 commits
- 修复block-wise的错误参数，以及增加dpsk-fp16-dtype的性能选择功能 · cb37537e
  yangql authored Jul 25, 2025
  
  cb37537e
- Triton-fused DeepseekScalingRotaryEmbedding · 7151fd54
  zhuwenwen authored Jul 25, 2025
  
  7151fd54
24 Jul, 2025 1 commit
- add fused_experts_impl of int8 · 41e6d686
  zhuwenwen authored Jul 24, 2025
  
  41e6d686
21 Jul, 2025 1 commit
- update List · 267cc5ff
  zhuwenwen authored Jul 21, 2025
  
  267cc5ff
18 Jul, 2025 2 commits
- update fused_moe.py · b1babea8
  zhuwenwen authored Jul 18, 2025
  
  b1babea8
- fix run error · 5c004388
  zhuwenwen authored Jul 18, 2025
  
  5c004388
14 Jul, 2025 1 commit
- update blockwise_int8.py · 5d35160b
  zhuwenwen authored Jul 14, 2025
  
  5d35160b
10 Jul, 2025 1 commit
- add apex rmsnorm · 3e0a595d
  zhuwenwen authored Jul 10, 2025
  
  3e0a595d
07 Jul, 2025 1 commit
- 修改激活量化算子实现方式 · b2fa85ce
  zhuwenwen authored Jul 07, 2025
  
  b2fa85ce
06 Jul, 2025 4 commits
- [Bugfix] Add `use_cross_encoder` flag to use correct activation in `ClassifierPooler` (#20527) · c18b3b8e
  Cyrus Leung authored Jul 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c18b3b8e
- [Benchmark] Add support for multiple batch size benchmark through CLI in... · cede942b
  Brayden Zhong authored Jul 06, 2025
```
[Benchmark] Add support for multiple batch size benchmark through CLI in `benchmark_moe.py` (#20516)
Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>
```
  cede942b
- [TPU][Bugfix] fix the MoE OOM issue (#20339) · 4548c03c
  Chengji Yao authored Jul 05, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  4548c03c
- [Bugfix] Fix missing per_act_token parameter in compressed_tensors_moe (#20509) · 43287082
  Lucia Fang authored Jul 06, 2025
```
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  43287082
05 Jul, 2025 1 commit
- Fix unknown attribute of topk_indices_dtype in CompressedTensorsW8A8Fp8MoECutlassMethod (#20507) · 8aeaa910
  Lucia Fang authored Jul 05, 2025
```
Co-authored-by: Lucia (Lu) Fang <fanglu@meta.com>
```
  8aeaa910
04 Jul, 2025 5 commits
- [feat]: CUTLASS block scaled group gemm for SM100 (#19757) · 3d184b95
  Duncan Moss authored Jul 04, 2025
```
Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Co-authored-by: Duncan Moss <dmoss@nvidia.com>
```
  3d184b95
- Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022
  Thomas Parnell authored Jul 04, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  2f35a022
- 增加稠密模型channelwise autotuning 接口 · 3e485650
  zhuwenwen authored Jul 04, 2025
  
  3e485650
- Support Llama 4 for fused_marlin_moe (#20457) · 0e3fe896
  Michael Goin authored Jul 04, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  0e3fe896
- [Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
  Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1caca5a5
03 Jul, 2025 7 commits
- [Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864) · 78fe7753
  bnellnm authored Jul 03, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  78fe7753
- [Model][2/N] Automatic conversion of CrossEncoding model (#19978) · 6f1229f9
  wang.yuqi authored Jul 03, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  6f1229f9
- [Quantization] Bump to use latest bitsandbytes (#20424) · 1819fbda
  Jee Jee Li authored Jul 03, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  1819fbda
- 修改美团 deepseek channel-wise模型 moe config获取 · bf3bf955
  zhuwenwen authored Jul 03, 2025
```
去除AutoTuning info提示信息
```
  bf3bf955
- 修改channelwise moe相关配置读取 · acf1b6c6
  zhuwenwen authored Jul 03, 2025
  
  acf1b6c6
- [Bugfix][CI/CD][CPU] Fix CPU CI tests (#20383) · 0ec3779d
  Li, Jiang authored Jul 03, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  0ec3779d
- [Bugfix] Fix import of CutlassExpertsFp8 in compressed_tensors_moe.py (#20381) · 2e25bb12
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
```
  2e25bb12
02 Jul, 2025 5 commits
- [Kernels] MoE refactor (#19636) · c1909e7e
  bnellnm authored Jul 02, 2025
```
Signed-off-by: Bill Nell <bnell@redhat.com>
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Co-authored-by: ElizaWszola <ewszola@redhat.com>
```
  c1909e7e
- [Bugfix] Fix dynamic rotary embedding (#20343) · 1a03dd49
  Cyrus Leung authored Jul 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  1a03dd49
- [Refactor] Remove Unused Env `VLLM_ENABLE_MOE_ALIGN_BLOCK_SIZE_TRITON` (#20334) · 9dae7d46
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  9dae7d46
- [Refactor] Remove duplicate `find_free_port` (#20333) · 7058d7dd
  Wentao Ye authored Jul 01, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7058d7dd
- Enable group size 64 for Machete (#20290) · 3abfe221
  czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
  3abfe221
01 Jul, 2025 7 commits

[V1] [ROCm] Enable EP with AITER Fused MoE (#20270) · 02cabff2
TJian authored Jul 01, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
02cabff2

[Model]Add Tencent HunYuanMoEV1 Model Support (#20114) · ecad851c

aiyiwang2025 authored Jul 01, 2025


Signed-off-by: aiyiwang <aiyiwang@tencent.com>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: quinnrong <quinnrong@tencent.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

ecad851c

Add GLM4.1V model (Draft) (#19331) · ed70f3c6

Yuxuan Zhang authored Jul 01, 2025


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

ed70f3c6

[Quant] [Bugfix] Fix quantization config matching with `hf_to_vllm_mapper` (#20046) · 9025a9a7
Kyle Sayers authored Jul 01, 2025

9025a9a7
[CPU] Update custom ops for the CPU backend (#20255) · 6cc1e7d9
Li, Jiang authored Jul 01, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
6cc1e7d9
Enable ZP Support for Machete (#20268) · 9909726d
czhu-cohere authored Jul 01, 2025
```
Signed-off-by: czhu-cohere <conway.zhu@cohere.com>
```
9909726d

[Feature] A calibration-free RTN-based quantization for accurate and... · 27949354

Alex Kogan authored Jul 01, 2025


[Feature] A calibration-free RTN-based quantization for accurate and accelerated INT4/INT8 inference (#18768)
Signed-off-by: Alex Kogan <alex.kogan@oracle.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

27949354