Commits · 09ad3b76b320fffcb6b0214bd90851c3328581ea · OpenDAS / vllm_cscc

"docs/vscode:/vscode.git/clone" did not exist on "f571ff8eb6d9117c6a418f7f925921968dff8ac8"

12 Dec, 2025 13 commits
- [Bug] Fix attention_backend arg string parsing (#30534) · 09ad3b76
  Michael Goin authored Dec 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09ad3b76
- fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) · dc13c99e
  Christina Norman authored Dec 12, 2025
```
Signed-off-by: Christina <truffle@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Christina Norman <christina@example.com>
Co-authored-by: Isotr0py <isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dc13c99e
- [DeepSeek V3.2] Proper drop_thinking logic (#30490) · 3e34adcd
  Vladislav Nosivskoy authored Dec 12, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  3e34adcd
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- [Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692) · f90319d5
  Jaehwang Jung authored Dec 12, 2025
  
  f90319d5
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
- [compile] Parse compile range cache keys as Range during cache loading. (#30516) · fe178710
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  fe178710
- [LMCache] Relax lmcache version requirement (#30425) · 947dfda9
  Nick Hill authored Dec 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  947dfda9
- [Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) · 9f2fc16a
  Michael Goin authored Dec 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9f2fc16a
- gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
  Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
  6a6fc41c
- [CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) · f355ad54
  Fadi Arafeh authored Dec 12, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  f355ad54
- [Core] Refactor `_build_attention_metadata` (#29628) · 042da732
  Lucas Wilkinson authored Dec 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  042da732
- [fix] fix SM check for Flashinfer TRTLLM MOE (#30314) · 0ab23c2b
  jiahanc authored Dec 11, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  0ab23c2b
11 Dec, 2025 27 commits
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- [Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) · c817b141
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  c817b141
- [Core] Whisper Enable Encoder Batching (#29421) · 0efd9f86
  Nicolò Lucchesi authored Dec 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0efd9f86
- [BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) · 90d6cf92
  Xingyu Liu authored Dec 11, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  90d6cf92
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
- [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) · 72aaac5b
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  72aaac5b
- [Feature] AWQ marlin quantization support for fused moe with lora (#30442) · 0e71eaa6
  汪志鹏 authored Dec 12, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  0e71eaa6
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [IMPROVEMENT] Change MistralReasoningParser behavior (#30391) · aa3c250c
  Julien Denize authored Dec 11, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  aa3c250c
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
- Make the `httpx` logger less annoying when Transformers v5 is installed (#30480) · 97a042f3
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97a042f3
- [Misc] Improve error message for `is_multimodal` (#30483) · 3a3b06ee
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3a3b06ee
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- [Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81
  Qiu authored Dec 11, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a11f4a81
- Fix typo of endpoint name in CLI args docs (#30473) · 853611bb
  Kenichi Maehashi authored Dec 11, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  853611bb
- [Deprecation] Deprecation `--convert reward`, use `--convert embed` instead. (#30463) · a5f9fb59
  wang.yuqi authored Dec 11, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a5f9fb59
- [Fix] Update lazing loading of video loader backend (#30444) · 4515eb1a
  jeremyteboul authored Dec 11, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  4515eb1a
- [Deprecation] Remove missed fallback for `embed_input_ids` (#30469) · 13d63b65
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13d63b65
- [bugfix] fix MiniMaxM2ReasoningParser streaming output not separating reasoning_content. (#29882) · 6299628d
  Rei. authored Dec 11, 2025
```
Signed-off-by: Rei <1477174254@qq.com>
```
  6299628d
- [perf] Use direct copy (broadcast) instead of cat for k_nope/k_pe in MLA prefill (#29710) · fba89069
  Ming Yang authored Dec 11, 2025
```
Signed-off-by: Ming Yang <minos.future@gmail.com>
```
  fba89069
- fix: enhance human_readable_int function (#30337) · d02d1043
  Ning Xie authored Dec 11, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d02d1043
- [Deprecation] Remove fallbacks for `embed_input_ids` and `embed_multimodal` (#30458) · 979f50ef
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  979f50ef
- Ensure minimum frames for GLM 4.6V compatibility (#30285) · 36c9ce25
  gh-wf authored Dec 11, 2025
```
Signed-off-by: Wayne Ferguson <wayneferguson@gmail.com>
```
  36c9ce25
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9