Commits · 3b06c55c78e85b6e71e086db3a77226405550f2d · OpenDAS / vllm_cscc · GitLab

22 Mar, 2026 7 commits
- [ROCm][CI] Fix MEGA_AOT_ARTIFACT fallback when PyTorch < 2.10.0 lacks AOT support (#37763) · 3b06c55c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3b06c55c
- [Perf] Optimize glm4.xv VIT (#37779) · b0507004
  Yang Liu authored Mar 22, 2026
```
Signed-off-by: Yang <lymailforjob@gmail.com>
```
  b0507004
- [Bugfix] Handle libsndfile sf_error(NULL) race condition in audio fallback (#37782) · 5dac719b
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  5dac719b
- [CI] Skip ISAAC multimodal tests due to broken upstream HF model weights (#37781) · c862481c
  Andreas Karatzas authored Mar 22, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c862481c
- [ROCm][CI] Add large_gpu_mark to test_max_tokens_none for ROCm (#37717) · c86b17cf
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c86b17cf
- [Bugfix] Fix pooling non-determinism from pinned prompt_lens aliasing (#37775) · 66f927f2
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  66f927f2
- [ROCm][CI] close missing quote in kernels/moe block in run-amd-test.sh (#37774) · e78bc742
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e78bc742
21 Mar, 2026 17 commits
- [MoE] Move FlashInfer CuteDSL experts into fused_moe/experts/ (#37759) · 6b2fa3a7
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  6b2fa3a7
- [Quantization][Deprecation] Remove PTPC FP8 (#32700) · eeee5b26
  Robert Shaw authored Mar 21, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  eeee5b26
- Revert "Consolidate AWQ quantization into single awq_marlin.py file" (#37768) · 5ad04465
  Robert Shaw authored Mar 21, 2026
  
  5ad04465
- Consolidate AWQ quantization into single awq_marlin.py file · 8cc700dd
  Robert Shaw authored Mar 21, 2026
```
Merge awq.py and awq_marlin.py into a single file, eliminating the
circular import between them. awq.py becomes a backward-compat shim.
Follows the same structure as gptq_marlin.py.

Co-authored-by: Claude
Signed-off-by: Robert Shaw <robertgshaw2@gmail.com>
```
  8cc700dd
- Add tensor IPC transfer mechanism for multimodal data (#32104) · 80b70884
  Brandon Pelfrey authored Mar 21, 2026
```
Signed-off-by: Brandon Pelfrey <bpelfrey@nvidia.com>
Signed-off-by: Brandon Pelfrey <brandonpelfrey@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  80b70884
- [Perf] Add SM 10.3 (B300/GB300) all-reduce communicator tuning (#37756) · 61e381dc
  Mohammad Miadh Angkad authored Mar 22, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  61e381dc
- [Core] Enable allreduce fusion by default for SM 10.3 (B300/GB300) (#37755) · 88f1b374
  Mohammad Miadh Angkad authored Mar 22, 2026
```
Signed-off-by: Mohammad Miadh Angkad <176301910+mmangkad@users.noreply.github.com>
```
  88f1b374
- [Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318) · 298e5108
  Francesco Fusco authored Mar 21, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  298e5108
- [ROCm] Enable DeepEP ROCm as all2allbackend for AMD GPUs. (#34692) · 3982bc2c
  Chaitanya Sri Krishna Lolla authored Mar 21, 2026
```
Signed-off-by: Tej Kiran <vpolamre@amd.com>
Co-authored-by: Tej Kiran <vpolamre@amd.com>
```
  3982bc2c
- [ROCm][CI] Update GSM8K eval config to use fp8-and-mixed models list (MI355) (#37721) · 02eec7ec
  Andreas Karatzas authored Mar 21, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  02eec7ec
- [Responses API] Add kv_transfer_params for PD disaggregation (#37424) · 17ee641c
  Bongwoo Bak authored Mar 21, 2026
```
Signed-off-by: bongwoobak <bongwoobak@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  17ee641c
- [ROCm][CI] Mark gemma3 as large GPU test to avoid OOM on MI250 (#37610) · 0d50fa1d
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  0d50fa1d
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
- [ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on... · 3ffa5200
  Andreas Karatzas authored Mar 20, 2026
```
[ROCm][CI] Guard CudaPlatform/RocmPlatform imports to fix test collection on cross-platform builds (#37617)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  3ffa5200
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
- Add get_device_uuid for rocm (#37694) · 1c472f8f
  tmm77 authored Mar 20, 2026
```
Signed-off-by: Tiffany Mintz <Tiffany.Mintz@amd.com>
```
  1c472f8f
20 Mar, 2026 16 commits
- elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
  Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  c57d38d6
- [BugFix] Allow qk_nope_head_dim=192 in FlashInfer MLA backend checks (#37475) · e5ed6c6c
  Kaihang Jiang authored Mar 20, 2026
```
Signed-off-by: Kaihang Jiang <kaihangj@nvidia.com>
```
  e5ed6c6c
- [Refactor] Remove unused dead code (#36171) · b3d0b379
  Wentao Ye authored Mar 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b3d0b379
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [ROCm][CI] Setting some mi325_4 tests back to optional (in parity with upstream) (#37711) · 8bc6b5cd
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  8bc6b5cd
- [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) · 4f16ebbb
  Vadim Gimpelson authored Mar 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4f16ebbb
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [Model] Update Kimi-K25 and Isaac processors to fit HF-style (#37693) · 37aadf62
  Cyrus Leung authored Mar 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  37aadf62
- [Bugfix] Disable --calculate-kv-scales for hybrid GDN/Mamba+Attention… (#37565) · d7d2b5e4
  Le Yang authored Mar 21, 2026
```
Signed-off-by: Young-Leo <562593859@qq.com>
```
  d7d2b5e4
- refactor: abstract deepgemm support into platform (#37519) · 6ec5e9fd
  SherryC41 authored Mar 21, 2026
```
Co-authored-by: sherryC41 <sherry.c.c41@gmail.com>
```
  6ec5e9fd
- [Attention] Support distinguishing between short extends and decodes (#37303) · e1d85e5c
  Lucas Wilkinson authored Mar 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e1d85e5c
- fix CUDAGraph memory being counted twice (#37426) · 79eb9369
  Peter Pan authored Mar 21, 2026
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  79eb9369
- [MRV2] Avoid recompilation of _gather_block_tables_kernel (#37645) · e80cfe57
  Woosuk Kwon authored Mar 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  e80cfe57
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- [ROCm][CI] Fix accuracy for llama-nemotron-vl pooling tests (#37613) · fb4e8bf4
  Andreas Karatzas authored Mar 20, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  fb4e8bf4
- Fix various config related issues for Transformers v5 (#37681) · 6ade4bc5
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6ade4bc5