Commits · 13618626dff735a794cae3dec4ac4c3d78de2e86 · OpenDAS / vllm_cscc · GitLab

12 Dec, 2025 21 commits
- [MoE-FP8-modelopt] Add FlashInfer alignment padding for intermediate dimensions (#29748) · 13618626
  danielafrimi authored Dec 12, 2025
```
Signed-off-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Signed-off-by: dafrimi <dafrimi@nvidia.com>
Co-authored-by: Daniel Afrimi <dafrimi@pool0-00589.cm.cluster>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  13618626
- [Fix]Load kv-cache dtype from hf_quant_config.json automatically (#29980) · 6ec0d8db
  danielafrimi authored Dec 12, 2025
```
Signed-off-by: Daniel Afrimi <dafrimi@nvidia.com>
```
  6ec0d8db
- [Perf] Set split_k to 1 for triton_kernels (#30528) · 1f19d8f8
  Xin Yang authored Dec 12, 2025
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  1f19d8f8
- [ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) · cd7740ac
  shivampr authored Dec 12, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
```
  cd7740ac
- [CI] Fix mypy for vllm/v1/executor (#30517) · 02a58803
  Wentao Ye authored Dec 12, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  02a58803
- [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
  realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
  d2c919dc
- [Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
  Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
  f3237f3f
- [Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306) · 9c0ee995
  jvlunteren authored Dec 12, 2025
```
Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
Signed-off-by: jvlunteren <161835099+jvlunteren@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  9c0ee995
- [Bug] Fix attention_backend arg string parsing (#30534) · 09ad3b76
  Michael Goin authored Dec 12, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  09ad3b76
- fix(gguf): Disable bfloat16 for GGUF on blackwell device (#30408) · dc13c99e
  Christina Norman authored Dec 12, 2025
```
Signed-off-by: Christina <truffle@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Christina Norman <christina@example.com>
Co-authored-by: Isotr0py <isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dc13c99e
- [DeepSeek V3.2] Proper drop_thinking logic (#30490) · 3e34adcd
  Vladislav Nosivskoy authored Dec 12, 2025
```
Signed-off-by: Vladislav Nosivskoy <vladnosiv@gmail.com>
```
  3e34adcd
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- [Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692) · f90319d5
  Jaehwang Jung authored Dec 12, 2025
  
  f90319d5
- [Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
  Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  8f8fda26
- [compile] Parse compile range cache keys as Range during cache loading. (#30516) · fe178710
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  fe178710
- [LMCache] Relax lmcache version requirement (#30425) · 947dfda9
  Nick Hill authored Dec 11, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  947dfda9
- [Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) · 9f2fc16a
  Michael Goin authored Dec 11, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  9f2fc16a
- gptq marlin quantization support for fused moe with lora (#30254) · 6a6fc41c
  Bhanu Prakash Voutharoja authored Dec 12, 2025
```
Signed-off-by: Bhanu068 <voutharoja.bhanu06@gmail.com>
```
  6a6fc41c
- [CPU][FIX] Fix build failures on Arm CPUs with torch nightly (#30481) · f355ad54
  Fadi Arafeh authored Dec 12, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  f355ad54
- [Core] Refactor `_build_attention_metadata` (#29628) · 042da732
  Lucas Wilkinson authored Dec 11, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  042da732
- [fix] fix SM check for Flashinfer TRTLLM MOE (#30314) · 0ab23c2b
  jiahanc authored Dec 11, 2025
```
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
```
  0ab23c2b
11 Dec, 2025 19 commits
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- [Perf] Optimize deepgemm experts initialization, 3.9% TTFT improvement (#30494) · c817b141
  Wentao Ye authored Dec 11, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: li-jinpeng <3332126450@qq.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>
```
  c817b141
- [Core] Whisper Enable Encoder Batching (#29421) · 0efd9f86
  Nicolò Lucchesi authored Dec 11, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0efd9f86
- [BugFix][MM]support VLLM_RANDOMIZE_DP_DUMMY_INPUTS (#30472) · 90d6cf92
  Xingyu Liu authored Dec 11, 2025
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  90d6cf92
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- [compile] Stop one-off setting enable_aot_compile and use context manager instead. (#30503) · 92fea56f
  Zhengxu Chen authored Dec 11, 2025
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  92fea56f
- [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) · 72aaac5b
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  72aaac5b
- [Feature] AWQ marlin quantization support for fused moe with lora (#30442) · 0e71eaa6
  汪志鹏 authored Dec 12, 2025
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  0e71eaa6
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [IMPROVEMENT] Change MistralReasoningParser behavior (#30391) · aa3c250c
  Julien Denize authored Dec 11, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  aa3c250c
- Give pooling examples better names (#30488) · 93db3256
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  93db3256
- Make the `httpx` logger less annoying when Transformers v5 is installed (#30480) · 97a042f3
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97a042f3
- [Misc] Improve error message for `is_multimodal` (#30483) · 3a3b06ee
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  3a3b06ee
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- [Misc][PCP&DCP] relocate PCP feature check (#30050) · a11f4a81
  Qiu authored Dec 11, 2025
```
Signed-off-by: QiuChunshuo <qiuchunshuo@huawei.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a11f4a81
- Fix typo of endpoint name in CLI args docs (#30473) · 853611bb
  Kenichi Maehashi authored Dec 11, 2025
```
Signed-off-by: Kenichi Maehashi <maehashi@preferred.jp>
```
  853611bb
- [Deprecation] Deprecation `--convert reward`, use `--convert embed` instead. (#30463) · a5f9fb59
  wang.yuqi authored Dec 11, 2025
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a5f9fb59
- [Fix] Update lazing loading of video loader backend (#30444) · 4515eb1a
  jeremyteboul authored Dec 11, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  4515eb1a
- [Deprecation] Remove missed fallback for `embed_input_ids` (#30469) · 13d63b65
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  13d63b65