Commits · 2092ce8c39a4f01a93dcb32d3c92d05586507e7c · OpenDAS / vllm_cscc · GitLab

21 Nov, 2025 29 commits
- Tool Call Parser logs should not contain user input / model output except on DEBUG (#29160) · 2092ce8c
  sfbemerk authored Nov 21, 2025
```
Signed-off-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Benjamin Merkel <benjamin.merkel@tngtech.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  2092ce8c
- fix cross attention (#28346) · fc9f821d
  who who who authored Nov 21, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
```
  fc9f821d
- Revert "Revert #28875 (#29159)" (#29179) · 94528630
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  94528630
- Update Dockerfile to use gcc-toolset-14 and fix test case failures on power (ppc64le) (#28957) · 2b1b3dfa
  Bhagyashri authored Nov 21, 2025
```
Signed-off-by: Bhagyashri <Bhagyashri.Gaikwad2@ibm.com>
```
  2b1b3dfa
- [Core] Align whisper closer to other multimodal models (#27292) · cca2d2cd
  Russell Bryant authored Nov 21, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  cca2d2cd
- [V0 deprecation] Remove more V0 references (#29088) · aab0102a
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  aab0102a
- [Misc] remove useless v1 env (#29164) · b34129bf
  WeiQing Chen authored Nov 21, 2025
```
Signed-off-by: David Chen <530634352@qq.com>
```
  b34129bf
- Revert #28875 (#29159) · 4d7231e7
  Cyrus Leung authored Nov 21, 2025
  
  4d7231e7
- [CI Failure] Fix Gemma3 RoPE configuration for sliding attention layers (#29111) · 8ac3a414
  Huamin Li authored Nov 20, 2025
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  8ac3a414
- [Minor][Clean] Remove the legacy assertion in video (#29150) · 7d6da483
  Canlin Guo authored Nov 21, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
```
  7d6da483
- [Small] Capture AttributeError when checking ray dependency. (#29024) · e4c3182c
  Chenheli Hua authored Nov 20, 2025
```
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
```
  e4c3182c
- [Bugfix] Fix default MM LoRA alignment for single str prompts (#29140) · b4734b95
  Alex Brooks authored Nov 20, 2025
```
Signed-off-by: Alex-Brooks <Alex.Brooks@ibm.com>
```
  b4734b95
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
- [Attention] Add ROCM_AITER_MLA_SPARSE to attention backend registry (#29103) · 11857a00
  Matthew Bonanni authored Nov 20, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  11857a00
- [BugFix] skip combo kernel on cpu (#29129) · 8c25f9cf
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  8c25f9cf
- [V0 Deprecation] Remove `best_of` (#29090) · 56e96b37
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  56e96b37
- [Doc] update installation guide regarding aarch64+cuda pytorch build (#28875) · 698024ec
  Qidong Su authored Nov 20, 2025
```
Signed-off-by: Qidong Su <soodoshll@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  698024ec
- [Core] Add audio_embeds support to chat completions (#29059) · 07304149
  jeremyteboul authored Nov 20, 2025
```
Signed-off-by: Jeremy Teboul <jeremyteboul@fb.com>
Co-authored-by: Jeremy Teboul <jeremyteboul@fb.com>
```
  07304149
- [kernel][perf] support uncontiguous input for rms_norm kernel (#28103) · a982f5b5
  zhrrr authored Nov 21, 2025
```
Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
```
  a982f5b5
- [Bugfix] Fix Plamo3 rope handling (#29092) · 0e741c12
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  0e741c12
- [CI] Fix mypy for `vllm/v1/worker` (#29037) · 56669c1f
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  56669c1f
- [ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) · 3f5f36da
  Hongxia Yang authored Nov 20, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
  3f5f36da
- [Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e1eefa4c
- [AITER] [ROCm] Fix crash when loading llama4 model with old aiter version... · ed6ae1e3
  Xiao Li authored Nov 20, 2025
```
[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124)
Signed-off-by: Xiao Li <ilx@meta.com>
```
  ed6ae1e3
- [LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
  Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  9875be64
- [Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput... · df44df01
  Wentao Ye authored Nov 20, 2025
```
[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  df44df01
- Update model references for OLMo3 (#29099) · 87cbbdff
  Michael Goin authored Nov 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  87cbbdff
- [CI Bugfix] Fix Kernels DeepGEMM Test (H100) (#29106) · 986ab5db
  Michael Goin authored Nov 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  986ab5db
- [Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e
  Rob Mulla authored Nov 20, 2025
```
Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dd39f91e
20 Nov, 2025 11 commits
- [CI/Build] Remove skip global cleanup in test_struct_output_generate.py (#29022) · c7a29d2c
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  c7a29d2c
- [CI/Build] Skip lm-format-enforcer tests in test_struct_output_generate.py for now (#29021) · 8237ab8a
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8237ab8a
- Fixes bench (#29058) · 3fd74189
  Driss Guessous authored Nov 20, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  3fd74189
- [CI/Build] Make test_attention_selector.py run tests on correct platform (#29064) · 5e5a7eb1
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5e5a7eb1
- [CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) · 3d84ef90
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  3d84ef90
- [Bugfix] - Add Trace Headers to Beam Search Path (#29100) · 4d01b642
  Software Developer authored Nov 20, 2025
```
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
```
  4d01b642
- [chore] Update annotate release scripts (#29077) · 114b0e25
  Kevin H. Luu authored Nov 20, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  114b0e25
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
- Updating the mirror of test-amd.yaml as of 2025-11-18 (#29016) · 22924383
  Alexei-V-Ivanov-AMD authored Nov 20, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  22924383
- [Frontend] Optimize beam search loop by sorting and then splicing (#19347) · 56f45edd
  rookie authored Nov 21, 2025
```
Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  56f45edd