Commits · b09806e28ffcc3e63176d668b2b3e965b35c986c · OpenDAS / vllm_cscc

13 Dec, 2025 4 commits

[Bugfix] Dictionary MM embeddings for online chat (#30507) · b09806e2
Cyrus Leung authored Dec 13, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
b09806e2

[Feature] Add SM103 (Blackwell Ultra) Support to vLLM (#30484) · 4fa7ce46

Roberto L. Castro authored Dec 13, 2025

Signed-off-by: LopezCastroRoberto <robertol.c510@gmail.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
Co-authored-by: youkaichao <youkaichao@gmail.com>

4fa7ce46

[CI] Whisper logprobs tests (#30504) · 57e9bf18
Nicolò Lucchesi authored Dec 13, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
57e9bf18

[CI] Update several models in registry that are available online now (#30514) · 2f32a68d

Michael Goin authored Dec 12, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2f32a68d

12 Dec, 2025 13 commits

[CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct... · 08f8a562

rasmith authored Dec 12, 2025


[CI/Build][Kernel][BugFix][AMD] Fix per_token_group_quant_fp8 to use correct fp8 min/max values and update atol/rtol in test_quantfp8_group_functionality  (#30292)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

08f8a562

[ROCm] Enable Triton ScaledMM fallback + kernel selection fix (#26668) · cd7740ac
shivampr authored Dec 12, 2025
```
Signed-off-by: Shivam <shivampr.dev@gmail.com>
Signed-off-by: Shivam <shivamprasad91@gmail.com>
```
cd7740ac
[bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
d2c919dc
[Frontend] Fixes anthropic streaming message_start usage nesting (#30266) · f3237f3f
Benjamin Bartels authored Dec 12, 2025
```
Signed-off-by: bbartels <benjamin@bartels.dev>
```
f3237f3f

[Kernel] Support CUDA Graphs in 3D Triton Attention Kernel (#28306) · 9c0ee995

jvlunteren authored Dec 12, 2025


Signed-off-by: Jan van Lunteren <jvl@zurich.ibm.com>
Signed-off-by: jvlunteren <161835099+jvlunteren@users.noreply.github.com>
Co-authored-by: Thomas Parnell <tom.parnell@gmail.com>
Co-authored-by: Thomas Parnell <tpa@zurich.ibm.com>

9c0ee995

[Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
3e41992f
[Bugfix] Schedule failure due to wrong get_image_size_with_most_features (#29692) · f90319d5
Jaehwang Jung authored Dec 12, 2025

f90319d5
[CI/Build][AMD] Fix ref_dynamic_per_token_quant reference implementation on ROCm. (#30291) · 302b2c1e
rasmith authored Dec 12, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
302b2c1e
[Bugfix] Multiple fixes for gpt-oss Chat Completion prompting (#28729) · 8f8fda26
Ben Browning authored Dec 11, 2025
```
Signed-off-by: Ben Browning <bbrownin@redhat.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
8f8fda26
[ROCm][CI] Skip multi-GPU speculative decoding tests when insufficient GPUs available (#30527) · 783644e4
Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
783644e4

[Bugfix][Model] Fix Afmoe rope_parameters issue (#30505) · 9f2fc16a

Michael Goin authored Dec 11, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

9f2fc16a

[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require... · ba809266

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip test_cutlass_w4a8_moe tests on ROCm sine they require cutlass_pack_scale_fp8 (#30508)
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

ba809266

[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that... · 48661d27

rasmith authored Dec 11, 2025


[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm  (#30417)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

48661d27

11 Dec, 2025 13 commits
- [EPLB] Support EPLB w/ NVFP4 (#29804) · a00d8897
  Andrew Briand authored Dec 11, 2025
```
Signed-off-by: Andrew Briand <abriand@nvidia.com>
Co-authored-by: Andrew Briand <abriand@nvidia.com>
```
  a00d8897
- Standardise `get_rope` to use `rope_parameters["partial_rotary_factor"]`, not `rotary_dim` (#30389) · cf3eacfe
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  cf3eacfe
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [IMPROVEMENT] Change MistralReasoningParser behavior (#30391) · aa3c250c
  Julien Denize authored Dec 11, 2025
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
```
  aa3c250c
- [CI] refine more logic when generating and using nightly wheels & indices, add... · 305b168a
  Shengqi Chen authored Dec 12, 2025
```
[CI] refine more logic when generating and using nightly wheels & indices, add cuda130 build for aarch64, specify correct manylinux version (#30341)
Signed-off-by: Shengqi Chen <harry-chen@outlook.com>
```
  305b168a
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- [Bugfix] Fix `task` still being passed in tests/benchmarks (#30476) · d917747c
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d917747c
- [Fix] Update lazing loading of video loader backend (#30444) · 4515eb1a
  jeremyteboul authored Dec 11, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  4515eb1a
- [bugfix] fix MiniMaxM2ReasoningParser streaming output not separating reasoning_content. (#29882) · 6299628d
  Rei. authored Dec 11, 2025
```
Signed-off-by: Rei <1477174254@qq.com>
```
  6299628d
- fix: enhance human_readable_int function (#30337) · d02d1043
  Ning Xie authored Dec 11, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  d02d1043
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26
- [Deprecation] Remove deprecated task, seed and MM settings (#30397) · 7e24e5d4
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  7e24e5d4
- [Deprecation] Remove deprecated plugin and compilation fields for v0.13 release (#30396) · 5a87d8b9
  Cyrus Leung authored Dec 11, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  5a87d8b9
10 Dec, 2025 10 commits

[Bugfix] fix confusing OOM errors during v1 init (#28051) · 8580919a

shivampr authored Dec 10, 2025


Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

8580919a

[Perf] Enable environment cache in EngineCore to enable the feature for... · 9f042ba2

Jialin Ouyang authored Dec 10, 2025


[Perf] Enable environment cache in EngineCore to enable the feature for UniProcExecutor as well (#29289)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

9f042ba2

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[Core] Whisper enable `FULL_DECODE_ONLY` CudaGraph (#30072) · c756fb67
Nicolò Lucchesi authored Dec 10, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
c756fb67
[CPU] Support for Whisper (#30062) · cebda2a4
Aditya Tewari authored Dec 10, 2025
```
Signed-off-by: Aditya Tewari <aditya.tewari@arm.com>
```
cebda2a4
[cpu][ci] Add CPU Attention Tests for Neon Backend (#30347) · 434ac76a
Fadi Arafeh authored Dec 10, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
434ac76a

[ROCm][CI] Attempt to fix the failures under a subgroup of the e2e the test group (#29358) · ed7af317

Andreas Karatzas authored Dec 09, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

ed7af317

[CI] Reduce Flakiness For test_spec_decode.py::test_suffix_decoding_acceptance (#30367) · 7d80c73d
Micah Williamson authored Dec 09, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
7d80c73d

[CI/Build][AMD] Skip quantization kernels tests that require CUTLASS or e4m3fn... · b75f826f

rasmith authored Dec 09, 2025


[CI/Build][AMD] Skip quantization kernels tests that require CUTLASS or e4m3fn when not supported by platform (#30020)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

b75f826f

[responsesAPI][6] Fix multi turn MCP tokenization (#30230) · c3487aca
Andrew Xia authored Dec 09, 2025
```
Signed-off-by: Andrew Xia <axia@fb.com>
Co-authored-by: Andrew Xia <axia@fb.com>
```
c3487aca