Commits · 9f2fc16a6903f8988515ce2560d3ef0850809c42 · OpenDAS / vllm_cscc

12 Dec, 2025 8 commits

[Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) · 9f2fc16a

Michael Goin authored Dec 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

9f2fc16a

gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
6a6fc41c
[CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) · f355ad54
Fadi Arafeh authored Dec 12, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
f355ad54
[Core] Refactor `_build_attention_metadata` (#29628) · 042da732
Lucas Wilkinson authored Dec 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
042da732
[ROCm][CI] Use mi325_4 agent pool for V1 e2e tests (#30526) · b5945d49
Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
b5945d49

[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require... · ba809266

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require cutlass_pack_scale_fp8 (#30508)
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ba809266

[fix] fix SM check for Flashinfer TRTLLM MOE (#30314) · 0ab23c2b
jiahanc authored Dec 11, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
0ab23c2b

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that... · 48661d27

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm  (#30417)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

48661d27

11 Dec, 2025 32 commits
- [FIX]Patch run-cluster.sh (fix for #28328) (#30002) · d527cf0b
  Ev Lacey authored Dec 11, 2025
```
Signed-off-by: elacey <elacey@nvidia.com>
Signed-off-by: Ev Lacey <github@everettlacey.com>
```
  d527cf0b
- [ROCM][CI] Fix AMD Examples Test Group (#30276) · 2cc5affc
  Concurrensee authored Dec 11, 2025
```
Signed-off-by: Yida Wu <yida.wu@amd.com>
Signed-off-by: Yida <yida.wu@amd.com>
```
  2cc5affc
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- [Refactor] Remove useless syncwarp (#30510) · 61249b17
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  61249b17
- [Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) · c817b141
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  c817b141
- [Docs][CPU backend] Add pre-built Arm CPU Docker images (#30491) · 3efdc3fe
  ioana ghiban authored Dec 11, 2025
```
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
```
  3efdc3fe
- [Core] Whisper Enable Encoder Batching (#29421) · 0efd9f86
  Nicolò Lucchesi authored Dec 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0efd9f86
- [BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) · 90d6cf92
  Xingyu Liu authored Dec 11, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  90d6cf92
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
- [Misc] Add mcp to requirements (#30474) · e458270a
  Ye (Charlotte) Qi authored Dec 11, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  e458270a
- [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) · 72aaac5b
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  72aaac5b
- [Feature] AWQ marlin quantization support for fused moe with lora (#30442) · 0e71eaa6
  汪志鹏 authored Dec 12, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  0e71eaa6
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [IMPROVEMENT] Change MistralReasoningParser behavior (#30391) · aa3c250c
  Julien Denize authored Dec 11, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  aa3c250c
- [CI] refine more logic when generating and using nightly wheels & indices, add... · 305b168a
  Shengqi Chen authored Dec 12, 2025
```
[CI] refine more logic when generating and using nightly wheels & indices, add cuda130 build for aarch64, specify correct manylinux version (#30341)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  305b168a
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
- [Docs][CPU Backend] Add nightly and per revision pre-built Arm CPU wheels (#30402) · 17cb5402
  ioana ghiban authored Dec 11, 2025
```
Signed-off-by: Ioana Ghiban <ioana.ghiban@arm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  17cb5402
- Make the `httpx` logger less annoying when Transformers v5 is installed (#30480) · 97a042f3
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97a042f3
- [Misc] Improve error message for `is_multimodal` (#30483) · 3a3b06ee
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3a3b06ee
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- [Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81
  Qiu authored Dec 11, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a11f4a81
- Fix typo of endpoint name in CLI args docs (#30473) · 853611bb
  Kenichi Maehashi authored Dec 11, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  853611bb
- [Bugfix] Fix `task` still being passed in tests/benchmarks (#30476) · d917747c
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d917747c
- [Deprecation] Deprecation `--convert reward`, use `--convert embed` instead. (#30463) · a5f9fb59
  wang.yuqi authored Dec 11, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a5f9fb59
- [Fix] Update lazing loading of video loader backend (#30444) · 4515eb1a
  jeremyteboul authored Dec 11, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  4515eb1a
- [Deprecation] Remove missed fallback for `embed_input_ids` (#30469) · 13d63b65
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13d63b65
- [Fix]fix import error from lmcache (#30376) · b4e8b912
  wz1qqx authored Dec 11, 2025
```
Signed-off-by: wz1qqx <ziqi.wang@novita.ai>
Co-authored-by: wz1qqx <ziqi.wang@novita.ai>
```
  b4e8b912
- [bugfix] fix MiniMaxM2ReasoningParser streaming output not separating reasoning_content. (#29882) · 6299628d
  Rei. authored Dec 11, 2025
```
Signed-off-by: Rei <1477174254@qq.com>
```
  6299628d
- [perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) · fba89069
  Ming Yang authored Dec 11, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fba89069
- fix: enhance human_readable_int function (#30337) · d02d1043
  Ning Xie authored Dec 11, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d02d1043
- [Deprecation] Remove fallbacks for `embed_input_ids` and `embed_multimodal` (#30458) · 979f50ef
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  979f50ef