Commits · a8eab8f30dda380a67c515c743365840b4347ccd · OpenDAS / vllm_cscc · GitLab

27 Mar, 2026 5 commits
- [Model] Extract GatedDeltaNetAttention into shared layer for Qwen3Next and Qwen3.5 (#37975) · a8eab8f3
  Xiaoshuang Wang authored Mar 27, 2026
```
Signed-off-by: wxsIcey <1790571317@qq.com>
Signed-off-by: Icey <1790571317@qq.com>
```
  a8eab8f3
- [frontend] dump openai responses type by alias (#38262) · 2babac0b
  cjackal authored Mar 27, 2026
```
Signed-off-by: cjackal <44624812+cjackal@users.noreply.github.com>
```
  2babac0b
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
- [Bugfix] Offload blocking tokenizer ops to shared thread pool to unblock event loop (#34789) · 999dfc16
  Bvicii authored Mar 26, 2026
```
Signed-off-by: Bvicii <yizhanhuang2002@gmail.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  999dfc16
- [CI/Build] enable Intel XPU test flow with prebuilt image (#37447) · d8606012
  wenjun liu authored Mar 27, 2026
```
Signed-off-by: wendyliu235 <wenjun.liu@intel.com>
```
  d8606012
26 Mar, 2026 35 commits
- Various Transformers v5 config fixes (#38247) · f73bcb1c
  Harry Mellor authored Mar 26, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f73bcb1c
- [Bugfix] Add missing f-string prefix in xgrammar choices error message (#38162) · 28048bd6
  yzong-rh authored Mar 26, 2026
```
Signed-off-by: Yifan Zong <yzong@redhat.com>
```
  28048bd6
- [Model Runner V2] Enable forcing a specific acceptance rate during rejection sampling (#38045) · c32e9760
  Giancarlo Delfin authored Mar 26, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c32e9760
- Fix multi-node allreduce fusion (#38136) · 0904b655
  Wei Zhao authored Mar 26, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: root <root@theia0053.lyris.clusters.nvidia.com>
```
  0904b655
- [Bugfix][ROCm] Fix lru_cache on paged_mqa_logits_module (#37547) · f26fcdfb
  Stig-Arne Grönroos authored Mar 26, 2026
```
Signed-off-by: Stig-Arne Grönroos <stig-arne.gronroos@amd.com>
```
  f26fcdfb
- [ROCm] [Bugfix] [Release] Fix nightly rocm release pipeline (#38263) · bc9c6fbb
  TJian authored Mar 27, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  bc9c6fbb
- [ROCm][CI] Override PYTORCH_ROCM_ARCH with detected GPU arch in test containers (#38165) · bff9a1c2
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bff9a1c2
- [ROCm][CI] Add uv pip compile workflow for rocm-test.txt lockfile (#37930) · db01535e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  db01535e
- [ROCM][Bugfix] Use correct stride in cp_mha_gather_cache_kernel for hybrid model (#37228) (#37228) · a4cf9b22
  jennyyyyzhen authored Mar 26, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: yZhen <yZhen@fb.com>
```
  a4cf9b22
- [ROCm][CI] Add LM Eval Qwen3.5 Models test for MI355 (#38155) · 9c3ae04b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9c3ae04b
- [CI] Fix conch kernel crash on 3D input by reshaping to 2D before GEMM (#38178) · a8e48a7b
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a8e48a7b
- [Mamba][APC] Add test case to compare apc outputs (#34977) · b9dbc5c4
  Divakar Verma authored Mar 26, 2026
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  b9dbc5c4
- [Releases] [ROCm] Enable Nightly Docker Image and Wheel Releases for ROCm (#37283) · 60af7b96
  TJian authored Mar 27, 2026
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  60af7b96
- [ROCm][CI] Fix AITER state leak in shared_fused_moe_routed_transform test (#38137) · bdc1719e
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  bdc1719e
- [Bugfix] Restore CUDA graph persistent buffers for FP8 FlashMLA decode (#35175) · 0aac2048
  haosdent authored Mar 27, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  0aac2048
- [Bugfix][Minor] Fix potential NameError in mamba backend selector and misc typos (#35886) · cb226321
  Chuan (Richard) Li authored Mar 26, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
  cb226321
- [CI] Add batch invariant test for b200 (#38014) · e054f152
  Wentao Ye authored Mar 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  e054f152
- [Fix] Remove unused packing_position_embedding from PaddleOCRVL for better... · 0f5b5260
  zhang-prog authored Mar 26, 2026
```
[Fix] Remove unused packing_position_embedding from PaddleOCRVL for better checkpoint compatibility (#38232)
Signed-off-by: zhangyue66 <zhangyue66@baidu.com>
```
  0f5b5260
- Revert "[MoE Kernel] Flashinfer nvfp4 cutedsl moe kernel integration" (#38050) (#38169) · be1a85b7
  Zhewen Li authored Mar 26, 2026
```
Co-authored-by: Zhewen Li <zhewenli@inferact.ai>
```
  be1a85b7
- [Renderer] Consolidate factory methods (#38218) · 2e225f7b
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  2e225f7b
- [bug-fix] GLM OCR Patch Merger context_dim (#37962) · 757eafcf
  Jared Wen authored Mar 26, 2026
```
Signed-off-by: JaredforReal <w13431838023@gmail.com>
```
  757eafcf
- [CI] Reorganize scoring tests (#38207) · dcdc1458
  wang.yuqi authored Mar 26, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  dcdc1458
- [ROCm][CI] Fix flaky GPTQ compile correctness test (#38161) · f2d16207
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  f2d16207
- [ROCm][CI] Fix wvSplitKrc mock argument order in test_rocm_unquantized_gemm (#38167) · 37a83007
  Andreas Karatzas authored Mar 26, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  37a83007
- [Refactor] Remove unused utils (#38153) · bf5eec63
  Wentao Ye authored Mar 26, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bf5eec63
- DOC: Documentation pages fixes (#38125) · b1cb1d3d
  Mateusz Sokół authored Mar 26, 2026
```
Signed-off-by: Mateusz Sokół <mat646@gmail.com>
```
  b1cb1d3d
- [XPU] Disable xpu graph by default (#38193) · 6ae8bbd0
  Kunshang Ji authored Mar 26, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  6ae8bbd0
- [Doc] Fix outdated reference to CUDAGraphManager (#38209) · a9213c0f
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  a9213c0f
- [Model] Use helper function to run MM processors with token inputs (where applicable) (#38018) · 502c41a8
  Cyrus Leung authored Mar 26, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  502c41a8
- [Bugfix] Fix DeepGemm E8M0 accuracy degradation for Qwen3.5 FP8 on Blackwell (#38083) · 52069012
  Vadim Gimpelson authored Mar 26, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  52069012
- [cpu][ci] remove soft-fail for Arm CI and add quant model tests (#37691) · 71161e8b
  Fadi Arafeh authored Mar 26, 2026
```
Signed-off-by: Fadi Arafeh <fadi.arafeh@arm.com>
```
  71161e8b
- [Model] Add torch.compile support for InternVL vision encoder (#38049) · 38de8223
  Terry Gao authored Mar 25, 2026
```
Signed-off-by: tianrengao <terrygao87@gmail.com>
```
  38de8223
- [Bugfix] Fix benchmark_fused_collective.py (#38082) · 2bfbdca2
  Jee Jee Li authored Mar 26, 2026
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
  2bfbdca2
- Add `/v1/chat/completions/batch` endpoint for batched chat completions (#38011) · 29080945
  Matej Rojec authored Mar 26, 2026
```
Signed-off-by: Matej Rojec <64556640+MatejRojec@users.noreply.github.com>
```
  29080945
- [Bugfix][CI] Fix Marlin FP8 Linear Kernel for Compressed Tensors Format (#38092) · e6bf9f15
  BadrBasowid authored Mar 26, 2026
```
Signed-off-by: BadrBasowid <Badr.Basowid@gmail.com>
Signed-off-by: BadrBasowid <61441185+BadrBasowid@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  e6bf9f15