Commits · f7ad6a1eb3deb9ca70a6bce3705dbd16cf9d8b28 · OpenDAS / vllm_cscc

12 Aug, 2025 4 commits
- [gpt-oss] Enable gpt-oss on ampere (#22714) · 007dd908
  Yongye Zhu authored Aug 12, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  007dd908
- [Bugfix] Mamba2 SSD varlen bug fix initstates decay, improve test, assert chunk pwr 2 (#21783) · 46ae7f66
  RishiAstra authored Aug 12, 2025
```
Signed-off-by: Rishi Astra <40644327+RishiAstra@users.noreply.github.com>
```
  46ae7f66
- Fix: AWQ Marlin get_quant_method does not recognize "modules_to_not_convert" (#21888) · 1ece7f30
  Jun-Howie authored Aug 12, 2025
```
Signed-off-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: JunHowie <JunHowie@aliyun.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1ece7f30
- [gpt-oss] Fix mxfp4 support (#22700) · bbaf9e9c
  Chen Zhang authored Aug 11, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  bbaf9e9c
11 Aug, 2025 4 commits
- [Model] Pooling models default to using chunked prefill & prefix caching if supported. (#20930) · 84cf78ac
  wang.yuqi authored Aug 12, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  84cf78ac
- [Feature] Add `VLLM_USE_DEEP_GEMM_E8M0` Env to Control E8M0 Scale (#21968) · f7dcce7a
  Wentao Ye authored Aug 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f7dcce7a
- [ROCm][AITER] Support AITER Rope ops in RotaryEmbedding Module. (#22521) · 9c97a1c3
  vllmellm authored Aug 11, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  9c97a1c3
- [Misc][gpt-oss] guard import when triton kernel when not up to date (#22584) · afa5b7ca
  Zhewen Li authored Aug 10, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  afa5b7ca
10 Aug, 2025 3 commits
- [Bugfix][Kernel] Support partial rotary embedding for MRoPE triton kernel (#22593) · b76753f0
  Isotr0py authored Aug 11, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  b76753f0
- [Minor] Fix pre-commit error on main (#22579) · 7e8d6857
  Isotr0py authored Aug 10, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
```
  7e8d6857
- [oss] Init gpt-oss bf16 support (#22508) · 0c5254b8
  Jee Jee Li authored Aug 10, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  0c5254b8
09 Aug, 2025 3 commits
- [FEAT] [Performance] Add triton mrope to replace the torch code path (#22375) · 42172ad1
  TJian authored Aug 09, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  42172ad1
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded
- [V1] [Hybrid] Support Minimax-Text-01 in V1 (#22151) · 6ade99ea
  Thomas Parnell authored Aug 09, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  6ade99ea
08 Aug, 2025 6 commits

[Misc] DeepGEMM : Avoid JIT generation in the hot-path (#22215) · f703b923

Varun Sundar Rabindranath authored Aug 08, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

f703b923

[gpt-oss] guard import when triton kernel is not installed (#22529) · f756a682

Yongye Zhu authored Aug 08, 2025


Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

f756a682

[gpt-oss] triton kernel mxfp4 (#22421) · e789cad6

Yongye Zhu authored Aug 08, 2025



Signed-off-by: <zyy1102000@gmail.com>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>

e789cad6

[bugfix] Fix Llama3/4 issues caused by FlashInfer 0.2.10 (#22426) · af473f0a
Po-Han Huang (NVIDIA) authored Aug 08, 2025
```
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
```
af473f0a
Fix Flashinfer CUTLASS MOE Allgather (#21963) · b2c8ce57
Shu Wang authored Aug 07, 2025
```
Signed-off-by: Shu Wang <shuw@nvidia.com>
```
b2c8ce57

Support Tensorrt-LLM MoE fp4 for low-latency (#21331) · a3b9c17b

Shu Wang authored Aug 07, 2025


Signed-off-by: Shu Wang <shuw@nvidia.com>
Signed-off-by: Po-Han Huang <pohanh@nvidia.com>
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: XIn Li <xinli@nvidia.com>
Co-authored-by: XIn Li <xinli@nvidia.com>

a3b9c17b

07 Aug, 2025 7 commits

[Misc] Enhance code formatting in mxfp4.py (#22423) · 136825de
Woosuk Kwon authored Aug 07, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
136825de

Add H20-3e fused MoE kernel tuning configs for GLM-4.5 (#22433) · c2dba2db

JaceyShao authored Aug 07, 2025


Signed-off-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>
Co-authored-by: shaojunqi <shaojunqi.sjq@alibaba-inc.com>

c2dba2db

[Misc] Support routing logic simulation (#21990) · 82216dc2

Ming Yang authored Aug 06, 2025

Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

82216dc2

[Bugfix] EPLB load statistics problem (#22167) · 4be02a37

WeiQing Chen authored Aug 07, 2025


Signed-off-by: ycyaw66 <497410282@qq.com>
Signed-off-by: David Chen <530634352@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>

4be02a37

[Bugfix] Add proper comparison for package versions (#22314) · 609b533c
Syed Muhammad Bin Asif authored Aug 07, 2025
```
Signed-off-by: Syed Muhammad Bin Asif <syedmba7@connect.hku.hk>
```
609b533c
[Bug] Fix B200 DeepGEMM E8M0 Accuracy Issue (#22399) · eec890c1
Wentao Ye authored Aug 06, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
eec890c1
[v1] - Mamba1 Attention Metadata (#21249) · 46a13949
Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
46a13949

06 Aug, 2025 2 commits

[gpt-oss] flashinfer mxfp4 (#22339) · 31f09c61

Yongye Zhu authored Aug 06, 2025


Signed-off-by: simon-mo <xmo@berkeley.edu>
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>

31f09c61

[Bugfix] Fix MoE BNB version (#22260) · 8e6c7e87
Jee Jee Li authored Aug 06, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
8e6c7e87

05 Aug, 2025 4 commits
- [Model] Pooling model activation supports per request control by PoolingParams (#20538) · 586f2867
  wang.yuqi authored Aug 05, 2025
```
Signed-off-by: wang.yuqi <noooop@126.com>
```
  586f2867
- [Log] DeepGEMM Update Log for Unaligned Problem Size (#22208) · d7b28f34
  Wentao Ye authored Aug 04, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d7b28f34
- [FEAT] Refactor ROPE into module (#22192) · 6ad6b8e1
  TJian authored Aug 04, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  6ad6b8e1
- [NVIDIA] Auto detect modelopt quant and fix DSR1-FP4 weight loading (#22073) · bdcb42e4
  Po-Han Huang (NVIDIA) authored Aug 05, 2025
  
  bdcb42e4
04 Aug, 2025 1 commit
- [feat] move WEIGHT_SCALE_SUPPORTED into raise block to accelerate RLHF weight loading (#21164) · c1b4eb04
  Weixiao Huang authored Aug 04, 2025
```
Signed-off-by: huangweixiao <huangweixiao@msh.team>
```
  c1b4eb04
03 Aug, 2025 1 commit

[CI/Build][Bugfix] Fix Qwen2.5 tests in CPU CI via fallback silu_and_mul to... · b5dfb94f

Li, Jiang authored Aug 03, 2025


[CI/Build][Bugfix] Fix Qwen2.5 tests in CPU CI via fallback silu_and_mul to torch native implementation (#22145)
Signed-off-by: jiang1.li <jiang1.li@intel.com>

b5dfb94f

02 Aug, 2025 5 commits

[xpu]support moe models on XPU platform (#21643) · 73e1b9b1
Yan Ma authored Aug 02, 2025
```
Signed-off-by: yan <yan.ma@intel.com>
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
73e1b9b1

[Model] Mamba2 preallocate SSM output tensor to avoid d2d copy overhead (#21075) · b690e348

Chih-Chieh Yang authored Aug 02, 2025


Signed-off-by: Chih-Chieh Yang <7364402+cyang49@users.noreply.github.com>
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>

b690e348

for glm-4.1V update (#22000) · 25373b6c

Yuxuan Zhang authored Aug 02, 2025


Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

25373b6c

[Bugfix] Mamba2 remove bugged initial state condition in chunk scan (#22034) · c64861d6
Chih-Chieh Yang authored Aug 02, 2025
```
Signed-off-by: Chih-Chieh-Yang <7364402+cyang49@users.noreply.github.com>
```
c64861d6
[Misc] DeepGemmExperts : Avoid JIT generation in the hot-path (#21955) · a65f46be
Varun Sundar Rabindranath authored Aug 02, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
a65f46be