Commits · 9319044ee9a1afc22327254ab983ead13324942e · OpenDAS / vllm_cscc · GitLab

02 Mar, 2026 30 commits
- [MoE][Perf] Wrap DSV3 QKVAProj GEMM in custom op for torch.compile (#35751) · 9319044e
  Robert Shaw authored Mar 02, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  9319044e
- clean unused cudagraph_batch_sizes (#35552) · c42dc402
  Boyuan Feng authored Mar 02, 2026
```
Signed-off-by: Boyuan Feng <boyuan@meta.com>
```
  c42dc402
- [Bugfix] Fix missing sequence_lengths in qwen3_omni_moe_thinker (#35741) · fa6a6be5
  Ye (Charlotte) Qi authored Mar 02, 2026
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  fa6a6be5
- [BUG] Fix rlhf_async example (#35788) · cad21918
  Aaron Hao authored Mar 02, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  cad21918
- [ci] Add Ray compatibility check informational CI job (#34672) · 53700bf4
  Jeffrey Wang authored Mar 02, 2026
```
Signed-off-by: Jeffrey Wang <jeffreywang@anyscale.com>
```
  53700bf4
- [KVConnector] Auto-downgrade to PIECEWISE cudagraph mode for layerwise async ops (#31057) · a13d8c03
  Yashwant Bezawada authored Mar 02, 2026
```
Signed-off-by: Yashwant Bezawada <yashwant_b@me.com>
```
  a13d8c03
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
- [torch.compile] Improve cold and warm start compile tests (#35709) · d1a6e96d
  Richard Zou authored Mar 02, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  d1a6e96d
- [BugFix][Model]Fix the garbled code in Ernie4.5-VL caused by fast_moe_cold_start (#35587) · 2a9e3347
  CSWYF3634076 authored Mar 03, 2026
```
Signed-off-by: wangyafeng <wangyafeng@baidu.com>
```
  2a9e3347
- [CI/Build] Enable Qwen3.5 tests on CI (#35763) · cc0d565f
  Isotr0py authored Mar 03, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  cc0d565f
- [CI][HPU] Pin vllm commit compatible with vllm-gaudi - HPU tests (#35307) · 358e4d5b
  Patryk Wolsza authored Mar 02, 2026
```
Signed-off-by: PatrykWo <patryk.wolsza@intel.com>
```
  358e4d5b
- [Doc] Improve UX of `--enable-log-requests` (#35723) · 792a74b9
  Cyrus Leung authored Mar 03, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  792a74b9
- [Core] Move test utility to test file (#35672) · 4034c3d3
  Turner Jabbour authored Mar 02, 2026
```
Signed-off-by: Turner Jabbour <doubleujabbour@gmail.com>
```
  4034c3d3
- [CI] Fix mypy for vllm/device allocator (#35518) · 7560d674
  Martin Hickey authored Mar 02, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7560d674
- [Performance] Extract kv update ops from MLA attention backends (#34627) · d9c77308
  ElizaWszola authored Mar 02, 2026
```
Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Di Wu <dw2761@nyu.edu>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
```
  d9c77308
- [Fix Bug]`num_active_loras` always equals to zero (#34119) · ada4f4fa
  Runkai Tao authored Mar 02, 2026
```
Signed-off-by: Runkai Tao <rt572@physics.rutgers.edu>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
```
  ada4f4fa
- [Docs] Add breadcrumbs for better UX (#35749) · 7e9149d9
  Harry Mellor authored Mar 02, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7e9149d9
- [MyPy][BugFix] Check profiler is assigned before calling start() on it (#35505) · 87c98b02
  Martin Hickey authored Mar 02, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  87c98b02
- Fix unresolved-import errors when using Astral's ty by removing src.root (#35681) · de7dd634
  Tyler Michael Smith authored Mar 02, 2026
```
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
```
  de7dd634
- [Feat] Supports Anthropic Messages count_tokens API (#35588) · 9a87b057
  Chauncey authored Mar 02, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9a87b057
- [Misc] Cleanup useless `current_platform` import (#35715) · 510bc9e1
  wangxiyuan authored Mar 02, 2026
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  510bc9e1
- [CPU][Distributed] Fix Enable _CPUSHMDistributed only when TP/PP ranks share... · cbd361fd
  Charles Ashby authored Mar 02, 2026
```
[CPU][Distributed] Fix Enable _CPUSHMDistributed only when TP/PP ranks share the same SHM group name (#34169)
Signed-off-by: Charles Ashby <charlesa.l@hotmail.com>
```
  cbd361fd
- [Misc] Bound NIXL upper bound version (#35495) · c212202d
  Nicolò Lucchesi authored Mar 02, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  c212202d
- [CI] Defining extended V1 e2e + engine tests (#35580) · ec27b36b
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ec27b36b
- [Rocm][CI] Fix LM Eval Large Models (H100) test group (#34750) · 3fd1d4ec
  Charlie Fu authored Mar 02, 2026
```
Signed-off-by: charlifu <charlifu@amd.com>
```
  3fd1d4ec
- [Kernel] Integrate SM100 MXFP8 blockscaled grouped MM and quant kernels (#34448) · cb21972a
  EdalatiAli authored Mar 02, 2026
```
Signed-off-by: EdalatiAli <aliedalati@cohere.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  cb21972a
- [ROCm][CI] Disable skinny GEMMs in language model standard tests to fix non-determinism (#35152) · c34963f1
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c34963f1
- [ROCm] add amd-quark package in requirements for rocm to use quantized models (#35658) · f26650d6
  Hongxia Yang authored Mar 02, 2026
```
Signed-off-by: Hongxia Yang <hongxiay.yang@amd.com>
Co-authored-by: Hongxia Yang <hongxiay.yang@amd.com>
```
  f26650d6
- [XPU] fix mxfp4 activation type (#35691) · 92f5d0f0
  Kunshang Ji authored Mar 02, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  92f5d0f0
- Fix deprecated v1 config tests (#35327) · a60985b0
  Jesse Cai authored Mar 01, 2026
```
Signed-off-by: Jesse Cai <jessecai@fb.com>
```
  a60985b0
01 Mar, 2026 10 commits
- [Attention] FA4 integration (#32974) · 8b5014d3
  Lucas Wilkinson authored Mar 01, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8b5014d3
- Revert "[Bugfix] Disable TRTLLM attention with KV transfer enabled (#33192)" (#34832) · 57a96e26
  zhanqiuhu authored Mar 01, 2026
```
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
```
  57a96e26
- [torch.compile] Undo the fast_moe_cold_start hack in torch>=2.11 (#35475) · e82fbeec
  Richard Zou authored Mar 01, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  e82fbeec
- [Bugfix] Fix dtype mismatch in RMSNormGated.forward_native() during torch.compile (#35256) · 62904708
  haosdent authored Mar 02, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  62904708
- [Model Runner V2] Use block table apis for capture inputs (#35671) · 72f4d162
  Woosuk Kwon authored Mar 01, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  72f4d162
- fix(mxfp4): return is_monolithic=False when LoRA is enabled for Triton backend (#35382) · 5a435507
  Seungho Yoon authored Mar 01, 2026
```
Signed-off-by: Seungho Yoon <yoonsnowdev@gmail.com>
```
  5a435507
- [MISC] Fixing a null reference by removing parallel_utils from mypy EXCLUDE (#35630) · 59d7af9c
  Taneem Ibrahim authored Mar 01, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  59d7af9c
- [Mamba1] - Kernel Level Chunk Alignment for Prefix Caching (#34798) · bbf81f9a
  Asaf Gardin authored Mar 01, 2026
```
Signed-off-by: Josephasafg <ajgard7@gmail.com>
```
  bbf81f9a
- [Model Runner V2] Minor refactoring for EncoderRunner (#35628) · da543d1a
  Woosuk Kwon authored Mar 01, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  da543d1a
- [AMD][CI] Support Triton attention with ExampleConnector (#34931) · 87d319c5
  Ryan Rock authored Mar 01, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  87d319c5