Commits · faedbb4d4fe4a56e111d23c9d657a1ef47cd7981 · OpenDAS / vllm_cscc

05 Nov, 2025 12 commits
- [Feature] Extend batch invariant torch.compile to B200 (#27856) · faedbb4d
  Paul Zhang authored Nov 05, 2025
```
Signed-off-by: PaulZhang12 <paulzhan@fb.com>
```
  faedbb4d
- [FlashInfer] Avoid FlashInfer block_size 16 + head_size 256 on blackwell (#27994) · c765f0b4
  Chen Zhang authored Nov 05, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  c765f0b4
- [Kernel] Fuse computation of g and beta for Gated Delta Net (#28095) · c18f88c6
  Jiangyun Zhu authored Nov 06, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  c18f88c6
- [Bugfix] Validate custom logits processor xargs for online serving (#27560) · 3f5a4b64
  Isotr0py authored Nov 06, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  3f5a4b64
- [BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546
  Ilya Markov authored Nov 05, 2025
```
Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  e50c4546
- [XPU] Enable custom routing functions in IPEX for Llama4 (#28004) · 6e97eccf
  Frost Mitchell authored Nov 05, 2025
```
Signed-off-by: frost-intel <frost.mitchell@intel.com>
```
  6e97eccf
- Bugfix: Cutlass FP8 FusedMoE bad scaling factors (#27255) · 6b7a8118
  amirkl94 authored Nov 05, 2025
```
Signed-off-by: Amir Klein <203507526+amirkl94@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  6b7a8118
- [Model, Core] Support Granite Speech & LoRA for STT (#24455) · b7cbc254
  Alex Brooks authored Nov 05, 2025
  
  b7cbc254
- [Bugfix] Fix encoder-only model support for transformers backend (#28021) · 0ff05e37
  Isotr0py authored Nov 05, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0ff05e37
- [V0 deprecation] Remove VLLM_USE_V1 usage in most modules (#27955) · 428bc7bf
  wangxiyuan authored Nov 05, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  428bc7bf
- [XPU] Add gpt-oss model support for Intel GPU (#27786) · 18b39828
  Kunshang Ji authored Nov 05, 2025
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  18b39828
- [Qwen3-Next] MOE configs for A100-SXM4-80GB TP4 TP8 (#27740) · 4ea62b77
  tou authored Nov 05, 2025
  
  4ea62b77
04 Nov, 2025 11 commits
- Revert "[PERF] Decouple projections from GDN custom op" (#28080) · d4e547bb
  Vadim Gimpelson authored Nov 05, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  d4e547bb
- [ROCm] gemm_a16w16 upstreaming (#26969) · 2d977a7a
  Aleksandr Malyshev authored Nov 04, 2025
```
Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>
```
  2d977a7a
- [model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f
  yt0428 authored Nov 05, 2025
```
Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  05cae69f
- [PERF] Decouple projections from GDN custom op (#27512) · 5fd8f02e
  Vadim Gimpelson authored Nov 04, 2025
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  5fd8f02e
- [Kernels] Isolate modular kernel code from FusedMoEMethodBase subclasses. (#27123) · 938772af
  bnellnm authored Nov 04, 2025
  
  938772af
- [Model] add optimal triton fused moe configs for NemotronH MoE (#27967) · e4ee6586
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  e4ee6586
- [Model][Bugfix] fix pipeline parallelism support for NemotronH (#27968) · 77f8001f
  tomeras91 authored Nov 04, 2025
```
Signed-off-by: Tomer Asida <57313761+tomeras91@users.noreply.github.com>
```
  77f8001f
- Support using Int4PreshuffledTensor after loading (#26066) · 03c4c4aa
  Jerry Zhang authored Nov 04, 2025
```
Signed-off-by: Jerry Zhang <jerryzh168@gmail.com>
```
  03c4c4aa
- [BugFix][Performance] Restore flashinfer autotuning for all scenarios (#27904) · 4022a9d2
  Varun Sundar Rabindranath authored Nov 04, 2025
  
  4022a9d2
- [Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata... · 7e4be741
  Wentao Ye authored Nov 04, 2025
```
[Bug] Batch invariant: Fix flash attn MLA `RuntimeError: scheduler_metadata must have shape (metadata_size)` (#27884)
```
  7e4be741
- [Bugfix][ROCm] Fix ViT rotary embeddings for torch.compile compatibility on ROCm (#27748) · b13a4475
  vllmellm authored Nov 04, 2025
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  b13a4475
03 Nov, 2025 4 commits
- [Bugfix] Fix MoE Routing Simulation (#28002) · 37587573
  Tyler Michael Smith authored Nov 03, 2025
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  37587573
- [Bugfix][plugin] fla crash on plugin (#27322) · ccd3e55e
  Hank_ authored Nov 04, 2025
  
  ccd3e55e
- [Bugfix][Qwen][Multimodal] Move Qwen2_5_vl sdpa to custom op and reenable compile (#27764) · 55011aef
  Lucas Kabela authored Nov 03, 2025
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  55011aef
- [Model] Add PaddleOCR-VL Model Support (#27758) · 40b69e33
  zhang-prog authored Nov 03, 2025
```
Signed-off-by: zhangyue <zhangyue66@baidu.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  40b69e33
02 Nov, 2025 2 commits
- [V1] [Hybrid] Mamba1 Automatic Prefix Caching (#26377) · 00b31a36
  Asaf Joseph Gardin authored Nov 02, 2025
```
Signed-off-by: asafg <39553475+Josephasafg@users.noreply.github.com>
```
  00b31a36
- [Bugfix] Fix Qwen Omni audio inference (#27920) · 853a8eb5
  Cyrus Leung authored Nov 02, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  853a8eb5
01 Nov, 2025 5 commits

[Bugfix] [Model] Missing MRoPE function definition from `KeyeForConditionalGeneration` (#27895) · e2347dbf
TJian authored Oct 31, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
e2347dbf

[CI/Build] Bump transformers version (#27528) · 879a0657

Cyrus Leung authored Nov 01, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

879a0657

[Multimodal][XPU]Enable vision attn backend for xpu platform (#27525) · 7e2729b5

Yan Ma authored Nov 01, 2025


Signed-off-by: Yan Ma <yan.ma@intel.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Co-authored-by: Yejing Lai <yejing.lai@intel.com>
Co-authored-by: Guancheng Fu <110874468+gc-fu@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

7e2729b5

[Bugfix] Fix KDA output (#27905) · 3a5de7d2
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
3a5de7d2
[Kernel] Enable FusedMoEModularKernel support bias (#27754) · bc4486d6
Jee Jee Li authored Nov 01, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
bc4486d6

31 Oct, 2025 5 commits
- Flashinfer_CUTLASS_MOE fuses quantization for TP (#27223) · fc16f1c4
  Shu Wang authored Oct 31, 2025
```
Signed-off-by: Shu Wang. <shuw@nvidia.com>
```
  fc16f1c4
- fix incorrect type annotation in KimiMLP (#27885) · bc306fe5
  ZiTian Zhao authored Nov 01, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  bc306fe5
- [Bugfix] Fix broken MRoPE for GLM-4.1V/GLM-4.5V (#27860) · 7e06c40e
  Isotr0py authored Nov 01, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  7e06c40e
- [Perf] Decouple torch op from GDA to leverage torch.compile (#27871) · 3857eb87
  Jiangyun Zhu authored Oct 31, 2025
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  3857eb87
- [Kimi-Linear] Correct prefixes and add compatibility to AWQ quants (#27834) · e5ef4dfc
  toncao authored Oct 31, 2025
```
Signed-off-by: toncao <cpatonn@gmail.com>
Co-authored-by: toncao <cpatonn@gmail.com>
```
  e5ef4dfc
30 Oct, 2025 1 commit

[Feature] Batch invariant torch.compile (#27660) · e7acb200

Paul Zhang authored Oct 30, 2025


Signed-off-by: PaulZhang12 <paulzhan@fb.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

e7acb200