Commits · c7a29d2c8d07ce6188d0c4bb19df6fd1d0e9bc74 · OpenDAS / vllm_cscc · GitLab

20 Nov, 2025 40 commits
- [CI/Build] Remove skip global cleanup in test_struct_output_generate.py (#29022) · c7a29d2c
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  c7a29d2c
- [CI/Build] Skip lm-format-enforcer tests in test_struct_output_generate.py for now (#29021) · 8237ab8a
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  8237ab8a
- Fixes bench (#29058) · 3fd74189
  Driss Guessous authored Nov 20, 2025
```
Signed-off-by: drisspg <drisspguessous@gmail.com>
```
  3fd74189
- [CI/Build] Make test_attention_selector.py run tests on correct platform (#29064) · 5e5a7eb1
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Signed-off-by: rasmith <Randall.Smith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  5e5a7eb1
- [CI/Build][AMD] Skip if flash_attn_varlen_func not available in test_aiter_flash_attn.py (#29043) · 3d84ef90
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  3d84ef90
- [Bugfix] - Add Trace Headers to Beam Search Path (#29100) · 4d01b642
  Software Developer authored Nov 20, 2025
```
Signed-off-by: dsuhinin <suhinin.dmitriy@gmail.com>
```
  4d01b642
- [chore] Update annotate release scripts (#29077) · 114b0e25
  Kevin H. Luu authored Nov 20, 2025
```
Signed-off-by: Kevin H. Luu <khluu000@gmail.com>
```
  114b0e25
- [KVConnector][Core] Support cross-layer KV blocks (#27743) · 64746471
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  64746471
- [BugFix][PD]: make example proxy usable with P2pNcclConnector (#26628) · e5bfcb6a
  Pan Li authored Nov 21, 2025
```
Signed-off-by: PAN <1162953505@qq.com>
```
  e5bfcb6a
- Updating the mirror of test-amd.yaml as of 2025-11-18 (#29016) · 22924383
  Alexei-V-Ivanov-AMD authored Nov 20, 2025
```
Signed-off-by: Alexei V. Ivanov <alexei.ivanov@amd.com>
```
  22924383
- [Frontend] Optimize beam search loop by sorting and then splicing (#19347) · 56f45edd
  rookie authored Nov 21, 2025
```
Signed-off-by: zhangguozhu <zhangguozhu@360.cn>
Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: zhangguozhu <zhangguozhu@360.cn>
Co-authored-by: mgoin <mgoin64@gmail.com>
```
  56f45edd
- [BugFix] [FEAT] Enable fastsafetensors for ROCm platform (#28225) · 82b05b15
  TJian authored Nov 20, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  82b05b15
- [BugFix] Fix flash_attn import in `siglip2navit.py` (#29082) · a2e9ebe9
  Fanli Lin authored Nov 20, 2025
```
Signed-off-by: Fanli Lin <fanli.lin@intel.com>
```
  a2e9ebe9
- [Bugfix] Fix spec decode memory regression after #28549 (#28819) · 93c8672c
  Zhewen Li authored Nov 20, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  93c8672c
- [RL] Add Pause and Resume Generation for Asynchronous RL Training (#28037) · 371b1d4c
  Samit authored Nov 20, 2025
```
Signed-off-by: SamitHuang <285365963@qq.com>
Signed-off-by: Samit <285365963@qq.com>
Signed-off-by: samithuang <285365963@qq.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  371b1d4c
- [MODEL] Implement plamo3 (#28834) · c9e09311
  Shinichi Hemmi authored Nov 20, 2025
```
Signed-off-by: Shinichi Hemmi <50256998+Alnusjaponica@users.noreply.github.com>
```
  c9e09311
- [BugFix] kv_offloading: Fix bug in loading of partial cpu blocks (#28951) · c0c2dd1e
  Or Ozeri authored Nov 20, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  c0c2dd1e
- [ROCm] Add AMD GPU support on Deepseek v3.2 and SparseMLA (#26670) · 06c20c99
  Pleaplusone authored Nov 20, 2025
```
Signed-off-by: ganyi <ygan@amd.com>
```
  06c20c99
- Add truncate arg to yarn to match openai implementation of gpt-oss (#28244) · 6eb745d9
  Anna Shors authored Nov 20, 2025
```
Signed-off-by: ashors1 <ashors@nvidia.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  6eb745d9
- [Chore] Update `xgrammar` version from 0.1.25 to 0.1.27 (#28221) · 66483a9d
  cjackal authored Nov 20, 2025
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  66483a9d
- [Misc] don't cache `CUTLASS_REVISION` var in CMakeLists.txt (#28518) · edfe8672
  Jinzhen Lin authored Nov 20, 2025
```
Signed-off-by: Jinzhen Lin <jinzhen.ljz@antgroup.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
```
  edfe8672
- [BugFix] Fix Llama4 Pipeline Parallelism Assert Error (#28577) · dc45efc8
  Dezhan authored Nov 20, 2025
```
Co-authored-by: Dezhan Tu <dztu@meta.com>
```
  dc45efc8
- [Bugfix][cache_kernels]: Fix OOB in cache_kernels.cu (#28760) · fb8851f2
  Vensen authored Nov 20, 2025
```
Signed-off-by: vensen <vensenmu@gmail.com>
Signed-off-by: Vensenmu <vensenmu@gmail.com>
```
  fb8851f2
- cleanup at::Tag::needs_fixed_stride_order (#28974) · a903d59f
  Boyuan Feng authored Nov 20, 2025
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a903d59f
- [CI/Build][AMD] Fix import errors in tests/kernels/attention (#29032) · 322cb028
  rasmith authored Nov 20, 2025
```
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  322cb028
- [Bug] Fix torch dynamo warning Dynamo detected a call to a `functools.lru_cache` (#29038) · 2c52c7fd
  Wentao Ye authored Nov 20, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  2c52c7fd
- [ci][amd] fix EPLB execution test (#28742) · 1e1c0678
  Bradley D authored Nov 19, 2025
```
Signed-off-by: Bradley Davis <bradleyhd@meta.com>
```
  1e1c0678
- [ROCm][BugFix] Fix shared expert loading error when disable... · 7218f839
  Pleaplusone authored Nov 20, 2025
```
[ROCm][BugFix] Fix shared expert loading error when disable `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` (#28633)
Signed-off-by: ganyi <ygan@amd.com>
```
  7218f839
- [V0 Deprecation] Remove `num_lookahead_slots` (#29000) · 20e4497b
  Cyrus Leung authored Nov 20, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  20e4497b
- [Frontend] Allow parsed tool arguments (#28820) · 1c7bcc55
  Quentin Gallouédec authored Nov 19, 2025
```
Signed-off-by: Quentin Gallouédec <45557362+qgallouedec@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  1c7bcc55
- [Model][QwenVL] Replace `torch.repeat_interleave` with faster `np.repeat` (#28964) · a9705a29
  Lukas Geiger authored Nov 20, 2025
```
Signed-off-by: Lukas Geiger <lukas.geiger94@gmail.com>
```
  a9705a29
- [Bugfix] Revert custom attention mask for gemma3-mm (#28995) · 64192d56
  Isotr0py authored Nov 20, 2025
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  64192d56
- [Bugfix] Handle broken frames in video loading (#29001) · fe25772a
  Canlin Guo authored Nov 20, 2025
```
Signed-off-by: gcanlin <canlinguosdu@gmail.com>
Signed-off-by: 凌葭 <lvjiang.lj@alibaba-inc.com>
Co-authored-by: 凌葭 <lvjiang.lj@alibaba-inc.com>
```
  fe25772a
- [Bugfix] Fix precision loss in LoRA-wrapped RowParallelLinear by fusing bias into GEMM (#28972) · 0cca9b4d
  prashanth058 authored Nov 19, 2025
```
Signed-off-by: prashanth058 <prashanth.dannamaneni@uipath.com>
```
  0cca9b4d
- Consolidate Nvidia ModelOpt quant config handling for all quantization methods (#28076) · a8c53682
  Shengliang Xu authored Nov 19, 2025
```
Signed-off-by: Shengliang Xu <shengliangx@nvidia.com>
```
  a8c53682
- [Feat] Iteration-level profiling for Torch and CUDA profiler (#28987) · fcbcba6c
  Benjamin Chislett authored Nov 19, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  fcbcba6c
- [cpu][ci] Add initial set of tests for Arm CPUs (#28657) · 3168285f
  Fadi Arafeh authored Nov 20, 2025
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  3168285f
- [AMD] Use Decoupled Kernel Block Size to Support AITER MLA block_size=1 (#27715) · 3fb0d909
  Qiang Zhang authored Nov 20, 2025
```
Signed-off-by: chiangzhang <chiangzhang@tencent.com>
```
  3fb0d909
- [DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache... · 05c2dee7
  Kuntai Du authored Nov 20, 2025
```
[DeepSeek + LMCache Multiprocess] handle MLA for deepseek model + LMCache Multiprocess connector (#29039)
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  05c2dee7
- [torchao] fix safetensors for sharding (#28169) · 1d642872
  liangel-02 authored Nov 19, 2025
```
Signed-off-by: Angel Li <liangel@meta.com>
```
  1d642872