Commits · fd65015a14be5f2ce663cd959dff6970285c54b4 · OpenDAS / vllm_cscc

22 Nov, 2025 12 commits
- [CI/Build] Only use supported types and features on ROCm in MoE kernel tests (#29149) · fd65015a
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  fd65015a
- [chore][LMCache connector] Remove useless logs from lmcache connector (#29069) · 77e1c035
  Yihua Cheng authored Nov 21, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  77e1c035
- [CI/Build][AMD] Enable Entrypoints Integration Test (Pooling) to run without error on ROCm (#29212) · 6f403501
  rasmith authored Nov 21, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  6f403501
- Add fused MoE config for H200 E160 N192 fp8 (#29182) · 052950e5
  FlintyLemming authored Nov 22, 2025
```
Signed-off-by: FlintyLemming <admin@flinty.moe>
```
  052950e5
- [CI/Build] Disable test_gptoss_tp.py in 'LoRA TP Test' group for ROCm platform (#29204) · 1ef9c9e2
  qli88 authored Nov 21, 2025
```
Signed-off-by: qli88 <qiang.li2@amd.com>
```
  1ef9c9e2
- [Bugfix] Fix block size in block_table with PCP (#29094) · 5c8f2adf
  Jie Luo authored Nov 22, 2025
```
Signed-off-by: Livinfly <luojie3m@gmail.com>
```
  5c8f2adf
- [CI/Build] Add terratorch for AMD (#29205) · ed8e6843
  Ryan Rock authored Nov 21, 2025
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  ed8e6843
- [Model][Qwen3VL] Tune Triton w8a8 block fp8 kernel for L40s (#29217) · d045e22d
  Lukas Geiger authored Nov 22, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  d045e22d
- [CI] Bug: Fix triton import issue (#29202) · 1d34eb11
  Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  1d34eb11
- [Rocm][CI] Fix DeekSeek V2-Lite Accuracy CI (#29135) · 9a3101b2
  Charlie Fu authored Nov 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  9a3101b2
- [docs] Fix cudagraph mode config (#29170) · d5dbdbfc
  Angela Yi authored Nov 21, 2025
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  d5dbdbfc
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 28 commits

[Model Runner V2] Optimize Gumbel Sampling Kernel (#29210) · e9af6ba6
Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
e9af6ba6
[KV Connector] Fix async connector prefix cache metrics (#28585) · c6fa3895
Mark McLoughlin authored Nov 21, 2025
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
c6fa3895
[BugFix] EPLB + B200 + DeepGEMM : Handle column-major scales tensor (#29162) · 3137991f
Varun Sundar Rabindranath authored Nov 21, 2025
```
Signed-off-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
Co-authored-by: Varun Sundar Rabindranath <vsundarr@redhat.com>
```
3137991f

Default model load/config/tokenizer to `mistral` format if relevant files exist (#28659) · 57430fc9

Julien Denize authored Nov 21, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

57430fc9

[BugFix] Fix missing symbol triggering FA2 fallback on Hopper (#29107) · c68c7b40
Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
c68c7b40
[log] add weights loading time log to sharded_state loader (#28628) · 53a1ba6e
Ning Xie authored Nov 22, 2025
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
53a1ba6e

[BugFix] Make sure to allocate worst case MoE workspace during profile run in... · 1840c5cb

Lucas Wilkinson authored Nov 21, 2025


[BugFix] Make sure to allocate worst case MoE workspace during profile run in the DP + EP case (#27426)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>

1840c5cb

[Chore] Fix pre-commit error after #25266 (#29190) · 1bed891f
Woosuk Kwon authored Nov 21, 2025

1bed891f
[Deprecation] Deprecate `seed=None` (#29185) · ceca0605
Cyrus Leung authored Nov 22, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
ceca0605
[ROCm][CI] Fix config/test_config_generation.py (#29142) · 75648b16
Charlie Fu authored Nov 21, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
```
75648b16
[NIXL] Fix after virtual block_size for host_buffer with heter kv_layout (#29122) · 460d02a4
Chendi.Xue authored Nov 21, 2025
```
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
```
460d02a4

Add TRTLLM MoE NVFP4 kernel to CompressedTensorsW4A4MoeMethod (#28892) · b4c8fbaa

Mingyuan Ma authored Nov 21, 2025


Signed-off-by: mingyuanm <mingyuanm@nvidia.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

b4c8fbaa

[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in... · e99e4673

rasmith authored Nov 21, 2025


[CI/Build][Kernel][AMD] Move extra dim to after load in _fwd_kv_parallel in lighting_attn.py (#29132)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

e99e4673

[Log] Optimize startup log (#28948) · a42ab317

Wentao Ye authored Nov 21, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

a42ab317

Upstream triton fp4 weight preshuffle (#28888) · b7f1f490

Aleksandr Malyshev authored Nov 21, 2025


Signed-off-by: Aleksandr Malyshev <maleksan@amd.com>
Co-authored-by: Aleksandr Malyshev <maleksan@amd.com>

b7f1f490

GPU Model Runner V2 (#25266) · 30b44a15
Woosuk Kwon authored Nov 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
30b44a15
[CI] Add batch invariant test to ci (#27842) · 1f400c58
Wentao Ye authored Nov 21, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
1f400c58

[CI/Build] Fix illegal memory access and unsupported test in... · 711241c1

rasmith authored Nov 21, 2025


[CI/Build] Fix illegal memory access and unsupported test in kernels/attention/test_cache.py (#29118)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>

711241c1

[Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
d7219bcd
[Doc] Update plugin doc (#28532) · 4050bae4
wangxiyuan authored Nov 21, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
4050bae4

[Perf] These changes enhance the NUMA functionality of vllm for systems with... · f1805db1

skaraban3807 authored Nov 21, 2025


[Perf] These changes enhance the NUMA functionality of vllm for systems with more than one NUMA nodes per socket (#25559)
Signed-off-by: Siddappa Karabannavar <siddappa.karabannavar@amd.com>

f1805db1

Fix mistral config (#29172) · 434f3d3e

Julien Denize authored Nov 21, 2025

Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>

434f3d3e

Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160) · 2092ce8c

sfbemerk authored Nov 21, 2025


Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>

2092ce8c

fix cross attention (#28346) · fc9f821d
who who who authored Nov 21, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
fc9f821d
Revert "Revert #28875 (#29159)" (#29179) · 94528630
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
94528630
Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) · 2b1b3dfa
Bhagyashri authored Nov 21, 2025
```
Signed-off-by: Bhagyashri <Bhagyashri.Gaikwad2@ibm.com>
```
2b1b3dfa
[Core] Align whisper closer to other multimodal models (#27292) · cca2d2cd
Russell Bryant authored Nov 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
cca2d2cd
[V0 deprecation] Remove more V0 references (#29088) · aab0102a
Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
aab0102a