Commits · a982f5b5ea4a1932424927ea357b532d0e45caf1 · OpenDAS / vllm_cscc

21 Nov, 2025 11 commits

[kernel][perf] support uncontiguous input for rms_norm kernel (#28103) · a982f5b5

zhrrr authored Nov 21, 2025


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

a982f5b5

[Bugfix] Fix Plamo3 rope handling (#29092) · 0e741c12

Cyrus Leung authored Nov 21, 2025

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

0e741c12

[CI] Fix mypy for `vllm/v1/worker` (#29037) · 56669c1f
Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
56669c1f
[ROCm] Fix for import when building with upstream triton for gfx1100 for gpt-oss serving (#29127) · 3f5f36da
Hongxia Yang authored Nov 20, 2025
```
Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>
```
3f5f36da
[Bug] Fix torch warning of tf32 usage (#29112) · e1eefa4c
Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
e1eefa4c

[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version... · ed6ae1e3

Xiao Li authored Nov 20, 2025


[AITER] [ROCm] Fix crash when loading llama4 model with old aiter version installed, fallback to forward_native implementation (#29124)
Signed-off-by: Xiao Li <ilx@meta.com>

ed6ae1e3

[LoRA][2/2]Remove LoRA extra vocab (#28545) · 9875be64
Jee Jee Li authored Nov 21, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
9875be64

[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput... · df44df01

Wentao Ye authored Nov 20, 2025


[Feature] Shared Experts Overlap with FI deepgemm swap kernel, 2.2% throughput improvement and 3.6% TTFT improvement (#28879)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

df44df01

Update model references for OLMo3 (#29099) · 87cbbdff

Michael Goin authored Nov 20, 2025


Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

87cbbdff

[CI Bugfix] Fix Kernels DeepGEMM Test (H100) (#29106) · 986ab5db
Michael Goin authored Nov 20, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
986ab5db

[Doc] cleanup TPU documentation and remove outdated examples (#29048) · dd39f91e

Rob Mulla authored Nov 20, 2025

Signed-off-by: Rob Mulla <rob.mulla@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

dd39f91e

20 Nov, 2025 29 commits
- [CI/Build] Remove skip global cleanup in test_struct_output_generate.py (#29022) · c7a29d2c
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  c7a29d2c
- [CI/Build] Skip lm-format-enforcer tests in test_struct_output_generate.py for now (#29021) · 8237ab8a
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8237ab8a
- Fixes bench (#29058) · 3fd74189
  Driss Guessous authored Nov 20, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  3fd74189
- [CI/Build] Make test_attention_selector.py run tests on correct platform (#29064) · 5e5a7eb1
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5e5a7eb1
- [CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) · 3d84ef90
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  3d84ef90
- [Bugfix] - Add Trace Headers to Beam Search Path (#29100) · 4d01b642
  Software Developer authored Nov 20, 2025
```
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
```
  4d01b642
- [chore] Update annotate release scripts (#29077) · 114b0e25
  Kevin H. Luu authored Nov 20, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  114b0e25
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
- Updating the mirror of test-amd.yaml as of 2025-11-18 (#29016) · 22924383
  Alexei-V-Ivanov-AMD authored Nov 20, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  22924383
- [Frontend] Optimize beam search loop by sorting and then splicing (#19347) · 56f45edd
  rookie authored Nov 21, 2025
```
Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  56f45edd
- [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) · 82b05b15
  TJian authored Nov 20, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  82b05b15
- [BugFix] Fix flash_attn import in `siglip2navit.py` (#29082) · a2e9ebe9
  Fanli Lin authored Nov 20, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  a2e9ebe9
- [Bugfix] Fix spec decode memory regression after #28549 (#28819) · 93c8672c
  Zhewen Li authored Nov 20, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  93c8672c
- [RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) · 371b1d4c
  Samit authored Nov 20, 2025
```
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  371b1d4c
- [MODEL] Implement plamo3 (#28834) · c9e09311
  Shinichi Hemmi authored Nov 20, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  c9e09311
- [BugFix] kv_offloading: Fix bug in loading of partial cpu blocks (#28951) · c0c2dd1e
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c0c2dd1e
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
- Add truncate arg to yarn to match openai implementation of gpt-oss (#28244) · 6eb745d9
  Anna Shors authored Nov 20, 2025
```
Signed-off-by: ashors1 <ashors@nvidia.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  6eb745d9
- [Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221) · 66483a9d
  cjackal authored Nov 20, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  66483a9d
- [Misc] don't cache `CUTLASS_REVISION` var in CMakeLists.txt (#28518) · edfe8672
  Jinzhen Lin authored Nov 20, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  edfe8672
- [BugFix] Fix Llama4 Pipeline Parallelism Assert Error (#28577) · dc45efc8
  Dezhan authored Nov 20, 2025
```
Co-authored-by: Dezhan Tu <dztu@meta.com>
```
  dc45efc8
- [Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760) · fb8851f2
  Vensen authored Nov 20, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
  fb8851f2
- cleanup at::Tag::needs_fixed_stride_order (#28974) · a903d59f
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a903d59f
- [CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) · 322cb028
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  322cb028
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
- [ci][amd] fix EPLB execution test (#28742) · 1e1c0678
  Bradley D authored Nov 19, 2025
```
Signed-off-by: Bradley Davis <bradleyhd@meta.com>
```
  1e1c0678
- [ROCm][BugFix] Fix shared expert loading error when disable... · 7218f839
  Pleaplusone authored Nov 20, 2025
```
[ROCm][BugFix] Fix shared expert loading error when disable `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` (#28633)
Signed-off-by: ganyi <ygan@amd.com>
```
  7218f839
- [V0 Deprecation] Remove `num_lookahead_slots` (#29000) · 20e4497b
  Cyrus Leung authored Nov 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  20e4497b