Commits · cca2d2cdbe56529205c10e58363c7bd2d31e15df · OpenDAS / vllm_cscc · GitLab

21 Nov, 2025 9 commits
- [Core] Align whisper closer to other multimodal models (#27292) · cca2d2cd
  Russell Bryant authored Nov 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cca2d2cd
- [V0 deprecation] Remove more V0 references (#29088) · aab0102a
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aab0102a
- [CI Failure] Fix Gemma3 RoPE configuration for sliding attention layers (#29111) · 8ac3a414
  Huamin Li authored Nov 20, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  8ac3a414
- [Bugfix] Fix Plamo3 rope handling (#29092) · 0e741c12
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0e741c12
- [CI] Fix mypy for `vllm/v1/worker` (#29037) · 56669c1f
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  56669c1f
- [ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) · 3f5f36da
  Hongxia Yang authored Nov 20, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  3f5f36da
- [Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e1eefa4c
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
- [Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput... · df44df01
  Wentao Ye authored Nov 20, 2025
```
[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  df44df01
20 Nov, 2025 12 commits
- [BugFix] Fix flash_attn import in `siglip2navit.py` (#29082) · a2e9ebe9
  Fanli Lin authored Nov 20, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  a2e9ebe9
- [Bugfix] Fix spec decode memory regression after #28549 (#28819) · 93c8672c
  Zhewen Li authored Nov 20, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  93c8672c
- [MODEL] Implement plamo3 (#28834) · c9e09311
  Shinichi Hemmi authored Nov 20, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  c9e09311
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
- Add truncate arg to yarn to match openai implementation of gpt-oss (#28244) · 6eb745d9
  Anna Shors authored Nov 20, 2025
```
Signed-off-by: ashors1 <ashors@nvidia.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  6eb745d9
- [BugFix] Fix Llama4 Pipeline Parallelism Assert Error (#28577) · dc45efc8
  Dezhan authored Nov 20, 2025
```
Co-authored-by: Dezhan Tu <dztu@meta.com>
```
  dc45efc8
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
- [ROCm][BugFix] Fix shared expert loading error when disable... · 7218f839
  Pleaplusone authored Nov 20, 2025
```
[ROCm][BugFix] Fix shared expert loading error when disable `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` (#28633)
Signed-off-by: ganyi <ygan@amd.com>
```
  7218f839
- [Model][QwenVL] Replace `torch.repeat_interleave` with faster `np.repeat` (#28964) · a9705a29
  Lukas Geiger authored Nov 20, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  a9705a29
- [Bugfix] Revert custom attention mask for gemma3-mm (#28995) · 64192d56
  Isotr0py authored Nov 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  64192d56
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
- [torchao] fix safetensors for sharding (#28169) · 1d642872
  liangel-02 authored Nov 19, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  1d642872
19 Nov, 2025 19 commits
- [Refactor] Optimize `select_experts` (#28069) · 5031cd5d
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  5031cd5d
- [Feature] EPLB on Qwen3VLMoe and CompressedTensorsWNA16MoEMethod (#28849) · 8e38e998
  JartX authored Nov 20, 2025
  
  8e38e998
- [CI] Fix precommit `rope_theta` issue (#29040) · 0075bfff
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0075bfff
- [Bugfix] Move flashinfer kernel check into ```__init__``` function of ```FusedMoE``` (#29018) · cb0a7b4b
  Max Hu authored Nov 19, 2025
```
Signed-off-by: Max Hu <hyoung2991@gmail.com>
```
  cb0a7b4b
- [DeepSeek] Fix DeepSeek V3.2 Rope Embedding (#28968) · 88f5b19f
  Yongye Zhu authored Nov 19, 2025
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
```
  88f5b19f
- [MoE] Nvfp4 Masked Gemm: Add flashinfer grouped_gemm_nt_masked (#25990) · 613abb50
  Shu Wang authored Nov 19, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  613abb50
- [Bug] Fix Batch Invariant MLA test (#28967) · 1607e664
  Wentao Ye authored Nov 19, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1607e664
- [Feature] Prefill Context Parallel (PCP) basic support (#28718) · 2fd893b4
  Qiu authored Nov 20, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Signed-off-by: FENP <yuanyongjie.yyj@antgroup.com>
Signed-off-by: LookAround <lixushi@huawei.com>
Signed-off-by: Jingchun Gao <gaojingchun1@huawei.com>
Signed-off-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: FENP <yuanyongjie.yyj@antgroup.com>
Co-authored-by: LookAround <lixushi@huawei.com>
Co-authored-by: Jingchun Gao <gaojingchun1@huawei.com>
Co-authored-by: zhenwenqi2024 <zhenwenqi_2022@qq.com>
Co-authored-by: Jingchun Gao <63247409+gjc0824@users.noreply.github.com>
```
  2fd893b4
- Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b
  Izzy Putterman authored Nov 19, 2025
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  02f5903b
- [Bugfix] Fix precision corruption when shared_experts_stream=None (#28942) · 9d2d5612
  杰兮 authored Nov 20, 2025
```
Signed-off-by: zhyajie <yajizhan@amd.com>
Co-authored-by: zhyajie <yajizhan@amd.com>
```
  9d2d5612
- [Kernels] Improve H200 Fused MoE Config (#28992) · fe69f331
  Robert Shaw authored Nov 19, 2025
```
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  fe69f331
- GLM-V video segmentation solution adjustment (#28941) · 0c80efd9
  Yuxuan Zhang authored Nov 20, 2025
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
```
  0c80efd9
- Update `rope_scaling` to `rope_parameters` in preparation for Transformers v5 (#28542) · a8b70304
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a8b70304
- [Model][Mamba] Add selector for mamba attention backend and make it pluggable... · d44e9df7
  Shanshan Shen authored Nov 20, 2025
```
[Model][Mamba] Add selector for mamba attention backend and make it pluggable for other device (#26487)
Signed-off-by: shen-shanshan <467638484@qq.com>
```
  d44e9df7
- Relax Transformers modeling backend MoE experts check (#28952) · 4f5299f7
  Harry Mellor authored Nov 19, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  4f5299f7
- [Feat][Perf] Enable deepep-low-latency with round-robin expert placement. (#28449) · da2f6800
  Chen Bruce authored Nov 19, 2025
```
Signed-off-by: bruceszchen <bruceszchen@tencent.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  da2f6800
- [Model][QwenVL] Simplify cos/sin rotary embedding indexing (#28962) · 3d4e7d34
  Lukas Geiger authored Nov 19, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  3d4e7d34
- [Bugfix] Fix typo in Qwen3 Next model executor (#28960) · 73ff872d
  Gleb Kurchanov authored Nov 19, 2025
```
Signed-off-by: Gleb Kurchanov <nepherpitou@gmail.com>
```
  73ff872d
- [Bugfix] Fix FusedMoEModularKernel for triton backend (#28913) · 468a8d72
  Xin Yang authored Nov 18, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  468a8d72