Commits · 30d64662387aaa74abcee294f27b83043f2d1ae6 · OpenDAS / vllm_cscc

22 Nov, 2025 1 commit
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 38 commits

[Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) · e9af6ba6
Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
e9af6ba6
[KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
c6fa3895
[BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
3137991f

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[log] add weights loading time log to sharded_state loader (#28628) · 53a1ba6e
Ning Xie authored Nov 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
53a1ba6e

[BugFix] Make sure to allocate worst case MoE workspace during profile run in... · 1840c5cb

Lucas Wilkinson authored Nov 21, 2025


[BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

1840c5cb

[Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
Woosuk Kwon authored Nov 21, 2025

1bed891f
[Deprecation] Deprecate `seed=None` (#29185) · ceca0605
Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ceca0605
[NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
460d02a4

Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) · b4c8fbaa

Mingyuan Ma authored Nov 21, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

b4c8fbaa

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in... · e99e4673

rasmith authored Nov 21, 2025


[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

e99e4673

[Log] Optimize startup log (#28948) · a42ab317

Wentao Ye authored Nov 21, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

a42ab317

Upstream triton fp4 weight preshuffle (#28888) · b7f1f490

Aleksandr Malyshev authored Nov 21, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>

b7f1f490

GPU Model Runner V2 (#25266) · 30b44a15
Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
30b44a15
[Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7219bcd
[Doc] Update plugin doc (#28532) · 4050bae4
wangxiyuan authored Nov 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
4050bae4

Fix mistral config (#29172) · 434f3d3e

Julien Denize authored Nov 21, 2025

Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

434f3d3e

Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160) · 2092ce8c

sfbemerk authored Nov 21, 2025


Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

2092ce8c

fix cross attention (#28346) · fc9f821d
who who who authored Nov 21, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
fc9f821d
[Core] Align whisper closer to other multimodal models (#27292) · cca2d2cd
Russell Bryant authored Nov 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
cca2d2cd
[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a

[CI Failure] Fix Gemma3 RoPE configuration for sliding attention layers (#29111) · 8ac3a414

Huamin Li authored Nov 20, 2025


Signed-off-by: Huamin Li <3ericli@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

8ac3a414

[Minor][Clean] Remove the legacy assertion in video (#29150) · 7d6da483
Canlin Guo authored Nov 21, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
7d6da483
[Small] Capture AttributeError when checking ray dependency. (#29024) · e4c3182c
Chenheli Hua authored Nov 20, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
e4c3182c
[Bugfix] Fix default MM LoRA alignment for single str prompts (#29140) · b4734b95
Alex Brooks authored Nov 20, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
b4734b95
Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
30b9c677
[Attention] Add ROCM_AITER_MLA_SPARSE to attention backend registry (#29103) · 11857a00
Matthew Bonanni authored Nov 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
11857a00
[BugFix] skip combo kernel on cpu (#29129) · 8c25f9cf
Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
8c25f9cf
[V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
56e96b37
[Core] Add audio_embeds support to chat completions (#29059) · 07304149
jeremyteboul authored Nov 20, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
07304149

[kernel][perf] support uncontiguous input for rms_norm kernel (#28103) · a982f5b5

zhrrr authored Nov 21, 2025


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a982f5b5

[Bugfix] Fix Plamo3 rope handling (#29092) · 0e741c12

Cyrus Leung authored Nov 21, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0e741c12

[CI] Fix mypy for `vllm/v1/worker` (#29037) · 56669c1f
Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
56669c1f
[ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) · 3f5f36da
Hongxia Yang authored Nov 20, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
3f5f36da
[Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e1eefa4c

[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version... · ed6ae1e3

Xiao Li authored Nov 20, 2025


[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124)
Signed-off-by: Xiao Li <ilx@meta.com>

ed6ae1e3

[LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
9875be64

[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput... · df44df01

Wentao Ye authored Nov 20, 2025


[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

df44df01

20 Nov, 2025 1 commit
- Fixes bench (#29058) · 3fd74189
  Driss Guessous authored Nov 20, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  3fd74189