Commits · 3035d1a166821272d4e7eb204e2c613bb02bacd7 · OpenDAS / vllm_cscc

13 Nov, 2025 7 commits
- [BugFix] DeepSeek-OCR: apply NoRepeatNGramLogitsProcessor to greedy path (#28617) · 3035d1a1
  Yuanping Song authored Nov 13, 2025
```
Signed-off-by: Yuanping Song <yuanping.song@outlook.com>
```
  3035d1a1
- [XPU] add sym params to IPEXConfig (#28611) · c47b6c85
  zofia authored Nov 13, 2025
```
Signed-off-by: Zhu, Zufang <zufang.zhu@intel.com>
```
  c47b6c85
- [BugFix] Fix type error when assign a trition kernel tensor to a torch.nn.Parameter (#28603) · 5e973209
  Zijing Liu authored Nov 13, 2025
```
Signed-off-by: Zijing Liu <liuzijing2014@gmail.com>
```
  5e973209
- [Bugfix] fix kimi-linear crash (#28445) · fa183e92
  Jiangyun Zhu authored Nov 13, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  fa183e92
- Support DeepEP for Kimi-k2-thinking through enabling gemm selection for... · 7e082bc1
  Lucia Fang authored Nov 12, 2025
```
Support DeepEP for Kimi-k2-thinking through enabling gemm selection for compressed-tensor marlin wna16 (#28574)
Signed-off-by: Lu Fang <fanglu@fb.com>
```
  7e082bc1
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
- [platform] Move get_cu_count to utils (#27005) · 2dacd573
  wangxiyuan authored Nov 13, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  2dacd573
12 Nov, 2025 15 commits

Skip models that cannot currently init on Transformers v5 (#28471) · 51c599f0
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
51c599f0
[MoE][Kernel][Perf] Improve Shared Expert Stream Overlap (#28406) · 69d0e903
Alexander Matveev authored Nov 12, 2025
```
Signed-off-by: Alexander Matveev <amatveev@redhat.com>
```
69d0e903

[ROCM] Fix ROCm warnings, environment flag access, and GEMM kernel naming for... · d8140b98

vllmellm authored Nov 13, 2025


[ROCM] Fix ROCm warnings, environment flag access, and GEMM kernel naming for consistency in `_aiter_ops.py` (#28464)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

d8140b98

[Performance][B200] Fix deepgemm prologue (#27897) · 74a9a9fa

Varun Sundar Rabindranath authored Nov 12, 2025


Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>

74a9a9fa

[EPLB][ROCm]: support EPBL for ROCm backend (#27731) · a1e7fa36
PerryZhang01 authored Nov 13, 2025
```
Signed-off-by: Perry Zhang <perzhang@amd.com>
Co-authored-by: Perry Zhang <perzhang@amd.com>
```
a1e7fa36
[Refactor] Remove redundant TP gather/split in split_qkv in QwenVL (#28271) · bc5bd45c
Canlin Guo authored Nov 12, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
bc5bd45c

[Performance][Hopper] Avoid M dim padding to 4x for most cases (due to cuda... · f76e85c2

Alexander Matveev authored Nov 12, 2025


[Performance][Hopper] Avoid M dim padding to 4x for most cases (due to cuda graphs paddings) (#28492)
Signed-off-by: Alexander Matveev <amatveev@redhat.com>

f76e85c2

Fix pre-commit (and XPU) on `main` (#28556) · 54aecd9e
Harry Mellor authored Nov 12, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
54aecd9e
[Bugfix] Fix gpt_oss packed_modules_mapping (#28536) · a9d18b51
Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
a9d18b51
[Model] fix glm4_moe_mtp load weights with GLM-4.6 checkpoint. (#27597) · d3ade61e
wuyaoxuehun authored Nov 12, 2025
```
Signed-off-by: wuao.scotty <wuao.scotty@bytedance.com>
Co-authored-by: wuao.scotty <wuao.scotty@bytedance.com>
```
d3ade61e
[BugFix]: --enable-lora with model granite-4.0-micro crash (#27733) · 1761dea1
yyzxw authored Nov 12, 2025
```
Signed-off-by: zxw <1020938856@qq.com>
```
1761dea1
[Core] Cache `vllm_is_batch_invariant` (#28304) · ac0bb2c3
Lukas Geiger authored Nov 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
ac0bb2c3
[BugFix] Add fallback path in `apply_rotary_pos_emb_flashattn` for non-cuda platforms (#28447) · b9ce9a30
Fanli Lin authored Nov 12, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
b9ce9a30

[Core] Encoder separation for Encode-Prefill-Decode Disaggregation (#25233) · 4ccffe56

Chenguang Zheng authored Nov 12, 2025


Signed-off-by: n00909098 <nguyen.kha.long@huawei.com>
Signed-off-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Signed-off-by: Khuong Le <khuong.le.manh@huawei.com>
Signed-off-by: Khuong Le <lemanhkhuong2611@gmail.com>
Co-authored-by: n00909098 <nguyen.kha.long@huawei.com>
Co-authored-by: knlnguyen1802 <knlnguyen1802@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Khuong Le <khuong.le.manh@huawei.com>
Co-authored-by: Khuong Le <lemanhkhuong2611@gmail.com>

4ccffe56

[Model][Qwen3VL] Simplify `get_mrope_input_positions` using numpy (#28302) · cbb799e3
Lukas Geiger authored Nov 12, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
cbb799e3

11 Nov, 2025 18 commits
- [Bugfix] Disable shared expert overlap if Marlin MoE is used (#28410) · e5f599d4
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  e5f599d4
- [LoRA][1/N]Remove LoRA extra vocab (#28382) · 9d1c4747
  Jee Jee Li authored Nov 12, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9d1c4747
- [Misc] Remove unused attention prefix prefill ops functions (#26971) · 76e4dcf2
  Lukas Geiger authored Nov 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  76e4dcf2
- [BugFix] Fix Siglip2Attention on XPU (#28448) · d5edcb86
  Fanli Lin authored Nov 12, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  d5edcb86
- [Quantization] fix attention quantization of gpt_oss model (#27334) · 5a1271d8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  5a1271d8
- [ROCm][Quantization] extend AMD Quark to support mixed-precision quantized model (#24239) · 05576df8
  xuebwang-amd authored Nov 12, 2025
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
Co-authored-by: fxmarty-amd <felmarty@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  05576df8
- [Kernel][Perf] fuse QK Norm and RoPE into one cuda kernel for Qwen Model (#27165) · 68c09efc
  zhrrr authored Nov 12, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
```
  68c09efc
- Remove weight_scale.T special case for SM90 Block FP8 CUTLASS kernel (#28431) · f9a40871
  Michael Goin authored Nov 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  f9a40871
- [BugFix] Fix RuntimeError in PixtralHFAttention on CPU/XPU (#28444) · b8860680
  Fanli Lin authored Nov 11, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  b8860680
- [Kernels] Split up fused_moe/layer.py, isolate more modular kernel code (#28064) · a1448b4b
  bnellnm authored Nov 11, 2025
  
  a1448b4b
- [Model] Pass `mm_features` directly into `get_mrope_input_positions` (#28399) · afffd3cc
  Cyrus Leung authored Nov 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  afffd3cc
- [Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03
  Matthew Bonanni authored Nov 11, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  b30dfa03
- [Model][Qwen3VL] Slighly speedup `fast_pos_embed_interpolate` (#28434) · 9973e6e0
  Lukas Geiger authored Nov 11, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  9973e6e0
- [BugFix] 'DeepseekV2Config' object has no attribute 'use_mla'` (#28387) · c7991269
  Fanli Lin authored Nov 11, 2025
```
Signed-off-by: Lin, Fanli <fanli.lin@intel.com>
```
  c7991269
- [Bugfix] fix qwen3-next crash (#28202) · f0359fff
  Jiangyun Zhu authored Nov 11, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  f0359fff
- [Bugfix] Fix max image size for PaddleOCR-VL (#28442) · 4fd4b743
  Roger Wang authored Nov 11, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
```
  4fd4b743
- [Bugfix] Fix Stream Sync for Shared Expert Overlap (#28430) · e605e8e3
  Robert Shaw authored Nov 11, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
Co-authored-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  e605e8e3
- [Feature] Add env var `VLLM_MOE_USE_DEEP_GEMM` (#28422) · de540c03
  Wentao Ye authored Nov 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  de540c03