Commits · 74a1ac38b00a8cf502db085d1bbd77712cf47e41 · OpenDAS / vllm_cscc

18 Dec, 2025 1 commit
- [v1] Add PrefixLM support to TritonAttention backend (#30386) · 74a1ac38
  Isotr0py authored Dec 18, 2025
  
  74a1ac38
17 Dec, 2025 11 commits
- [BugFix] Workspace allocation during profile run : DeepEPHighThroughput + DeepGEMM (#30899) · e3fc374a
  Varun Sundar Rabindranath authored Dec 17, 2025
  
  e3fc374a
- 2.9.1 PyTorch release update (#28495) · e06d0bf0
  Andrey Talman authored Dec 17, 2025
  
  e06d0bf0
- [Model] Gemma3: Support untied word embeddings (#30827) · 196cdc32
  KimHyemin authored Dec 18, 2025
```
Signed-off-by: www-spam <panmahm@naver.com>
```
  196cdc32
- [Bugfix] deepseek-V3.2 self.weights_proj has no bias (#30841) · 84896fda
  baoqian426 authored Dec 17, 2025
```
Signed-off-by: baoqian <1354987947@qq.com>
Signed-off-by: baoqian426 <1354987947@qq.com>
```
  84896fda
- [Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute... · f284d7bd
  Wentao Ye authored Dec 17, 2025
```
[Bug] Fix AttributeError: 'ColumnParallelLinear' object has no attribute `weight_scale_inv` (#30823)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  f284d7bd
- CustomOp: grouped topk (#29575) · 3b1d440e
  Xinyu Chen authored Dec 17, 2025
```
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
```
  3b1d440e
- [Mamba] Removed disable cascade attn in MambaModelConfig (#30712) · a9e15c21
  Asaf Joseph Gardin authored Dec 17, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  a9e15c21
- [XPU] fix broken fp8 online quantization for XPU platform (#30831) · 4f735bab
  Yan Ma authored Dec 17, 2025
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  4f735bab
- [Bugfix][CPU] Fix CPU backend ROPE dispatch for VL models (#30829) · 0cd53536
  Li, Jiang authored Dec 17, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
Signed-off-by: Li, Jiang <bigpyj64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  0cd53536
- Update note comment for flashinfer attention warmup (#30711) · d4d27517
  Michael Goin authored Dec 17, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  d4d27517
- Fix nemotron_nas intermediate_size computation (#30795) · f5db6385
  Grzegorz K. Karch authored Dec 17, 2025
```
Signed-off-by: Grzegorz Karch <gkarch@nvidia.com>
```
  f5db6385
16 Dec, 2025 10 commits
- [Kernel][Quantization][MoE] add marlin kernel support for turing (sm75) (#29901) · ce96857f
  Jinzhen Lin authored Dec 17, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  ce96857f
- [Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
  Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
  f5f51e59
- [Perf] Do FP4 quant before All gather on flashinfer trtllmgen MOE (#30014) · 254a7f8f
  jiahanc authored Dec 16, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  254a7f8f
- [CI] Generalize gsm8k test args and add Qwen3-Next MTP B200 test (#30723) · 10ee1c64
  Michael Goin authored Dec 16, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  10ee1c64
- Remove `head_mask` from Ultravox and Swin (#30764) · 0b0acc75
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0b0acc75
- [TRTLLM] Remove the MoE GEMM weight name change (#30713) · ce12b407
  Ming Yang authored Dec 16, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  ce12b407
- [Feat] Enable eplb with default all2all backend (#30559) · 59bd5f6a
  Wentao Ye authored Dec 16, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  59bd5f6a
- Don'e assume `position_embedding_type` will be present for BERT and RoBERTa models (#30770) · 6f15ac5d
  Harry Mellor authored Dec 16, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6f15ac5d
- [Bugfix] Fix broken ViT attention selection for Blackwell device (#30731) · e94384bb
  Isotr0py authored Dec 16, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e94384bb
- [CustomOp] Extract ApplyRotaryEmb as CustomOp and unify the dispatch logic (#29873) · 3bd9c491
  Shanshan Shen authored Dec 16, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Co-authored-by: gcanlin <canlinguosdu@gmail.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  3bd9c491
15 Dec, 2025 9 commits

Update batch invariant to use attention config (#30704) · 60dbf7d8

Matthew Bonanni authored Dec 15, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

60dbf7d8

[MoE][Refactor 1/N] Separate Online Quantization (#30627) · d0502b49
Robert Shaw authored Dec 15, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
d0502b49
[Bugfix] Fix multimodal configuration for Qwen3VL MOE model (#30670) · 3f175f18
Max Hu authored Dec 15, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
3f175f18
[BugFix] Add embed_input_ids method to make QWenLMHeadModel a vllm model (#30674) · e4806d97
duke authored Dec 15, 2025
```
Signed-off-by: root <iwzbi@zju.edu.cn>
Co-authored-by: root <iwzbi@zju.edu.cn>
```
e4806d97
[Model] Automatic conversion of TokenClassification model (#30666) · 4429d934
wang.yuqi authored Dec 15, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
4429d934

[New Model] BAGEL support (AR only) (#28439) · 1adeb3b8

汪志鹏 authored Dec 15, 2025


Signed-off-by: princepride <wangzhipeng628@gmail.com>
Signed-off-by: 汪志鹏 <wangzhipeng628@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

1adeb3b8

[Feat] Refactor for `parallel_config` in `FusedMoEModularKernel` (#30282) · 3778673e

Wentao Ye authored Dec 14, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

3778673e

[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend... · 87b4d155

Shanshan Shen authored Dec 15, 2025


[CustomOp][MM] Extract MMEncoderAttention as CustomOp and replace the backend of QwenVisionAttention with it. (#30125)
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

87b4d155

[CustomOp] Support object-level enable for CustomOp (#30547) · 738648fb
Shanshan Shen authored Dec 15, 2025
```
Signed-off-by: shen-shanshan <467638484@qq.com>
```
738648fb

14 Dec, 2025 7 commits

[Feature]Add EVS (Efficient Video Sampling) Support for Qwen3-VL (#29752) · ae88aada
ZiTian Zhao authored Dec 14, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
Co-authored-by: deitxfge <huhaibo1990@126.com>
```
ae88aada
[Bugfix] Revert Qwen2-VL part of change in #28271 (#30542) · 48b8456f
zifeitong authored Dec 14, 2025
```
Signed-off-by: Zifei Tong <zifeitong@gmail.com>
```
48b8456f
[Bugfix] fix _get_quant_method of FusedMoE for deepseekV3.2 on non-NV… (#30057) · 6ecc1e41
tjp_zju authored Dec 14, 2025
```
Signed-off-by: tjp_zju <tanjianpingzju1990@gmail.com>
```
6ecc1e41

Nvidia ModelOpt workaround for issue 28072 (#30164) · 0bb0bae4

Shengliang Xu authored Dec 14, 2025


Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
Co-authored-by: Pavani Majety <pmajety@nvidia.com>

0bb0bae4

[torch.compile] Add encoder tag for compilation (#30489) · 3224ea99
Ilya Markov authored Dec 14, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
```
3224ea99

Add AudioFlamingo3 model support (#30539) · 3a20450d

Lasha Koroshinadze authored Dec 14, 2025


Signed-off-by: Lasha <26011196+lashahub@users.noreply.github.com>
Signed-off-by: Lasha Koroshinadze <26011196+lashahub@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>