Commits · 84ac1d27a013814b49afadad241f2dc795cc2c4a · OpenDAS / vllm_cscc

09 May, 2026 1 commit
- add step3p5 mtp3 · 84ac1d27
  zhangning3 authored May 09, 2026
  
  84ac1d27
30 Mar, 2026 1 commit
- [Bugfix][MLA] Change default SM100 MLA prefill backend back to TRT-LLM (#38562) · a26e8dc7
  Matthew Bonanni authored Mar 30, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
(cherry picked from commit 2c734ed0e06a48808522fe8f59f6b4ffe0cf0397)
```
  a26e8dc7
27 Mar, 2026 1 commit
- cherry-pick [Bugfix] Restore prepare_fp8_layer_for_marlin removed by merge conflict resolution · 7624525b
  Vadim Gimpelson authored Mar 27, 2026
```
Signed-off-by: khluu <khluu000@gmail.com>
Co-authored-by: vadiklyutiy <vgimpelson@nvidia.com>
#38398
```
  7624525b
26 Mar, 2026 2 commits
- merge · 9fdc0f3a
  khluu authored Mar 26, 2026
```
Signed-off-by: khluu <khluu000@gmail.com>
```
  9fdc0f3a
- merge · 05d96d79
  Vadim Gimpelson authored Mar 26, 2026
```
Signed-off-by: khluu <khluu000@gmail.com>
```
  05d96d79
25 Mar, 2026 2 commits

Update modelopt.py · 6f1beee6
zhuwenwen authored Mar 25, 2026

6f1beee6

[Bugfix] Fix mock.patch resolution failure for... · ccbc5ac4

Dimitrios Bariamis authored Mar 17, 2026


[Bugfix] Fix mock.patch resolution failure for standalone_compile.FakeTensorMode on Python <= 3.10 (#37158)
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
(cherry picked from commit 1204cf0a)

ccbc5ac4

24 Mar, 2026 3 commits
- Update nano_nemotron_vl.py · 58beb740
  zhuwenwen authored Mar 24, 2026
  
  58beb740
- sync v0.18.0 · eefa41c1
  zhuwenwen authored Mar 24, 2026
  
  eefa41c1
- skip cp_gather_and_upconvert_fp8_kv_cache · 82155c76
  zhuwenwen authored Mar 24, 2026
  
  82155c76
21 Mar, 2026 7 commits
- [Hybrid] calling get_mamba_groups() once at MambaCopyBuffers.create() (#37318) · 298e5108
  Francesco Fusco authored Mar 21, 2026
```
Signed-off-by: Francesco Fusco <ffu@zurich.ibm.com>
```
  298e5108
- [ROCm] Enable DeepEP ROCm as all2allbackend for AMD GPUs. (#34692) · 3982bc2c
  Chaitanya Sri Krishna Lolla authored Mar 21, 2026
```
Signed-off-by: Tej Kiran <vpolamre@amd.com>
Co-authored-by: Tej Kiran <vpolamre@amd.com>
```
  3982bc2c
- [Responses API] Add kv_transfer_params for PD disaggregation (#37424) · 17ee641c
  Bongwoo Bak authored Mar 21, 2026
```
Signed-off-by: bongwoobak <bongwoobak@gmail.com>
Co-authored-by: Chauncey <chaunceyjiang@gmail.com>
```
  17ee641c
- Revert "[compile] Initialize passes at VllmBackend init" (#37733) · 1fa1e53a
  Simon Mo authored Mar 20, 2026
  
  1fa1e53a
- [MoE Refactor] Mxfp4 oracle rebased (#37128) · 87bd9189
  Yongye Zhu authored Mar 20, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
```
  87bd9189
- [Frontend] Remove librosa from audio dependency (#37058) · c7f98b4d
  Isotr0py authored Mar 21, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c7f98b4d
- Add get_device_uuid for rocm (#37694) · 1c472f8f
  tmm77 authored Mar 20, 2026
```
Signed-off-by: Tiffany Mintz <Tiffany.Mintz@amd.com>
```
  1c472f8f
20 Mar, 2026 23 commits
- elastic_ep: Fix issues with repeated scale up/down cycles (#37131) · c57d38d6
  Itay Alroy authored Mar 21, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  c57d38d6
- [BugFix] Allow qk_nope_head_dim=192 in FlashInfer MLA backend checks (#37475) · e5ed6c6c
  Kaihang Jiang authored Mar 20, 2026
```
Signed-off-by: Kaihang Jiang <kaihangj@nvidia.com>
```
  e5ed6c6c
- [Refactor] Remove unused dead code (#36171) · b3d0b379
  Wentao Ye authored Mar 20, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  b3d0b379
- [Model Runner V2] Support Streaming Inputs (#37028) · 85f671b8
  Santino Ramos authored Mar 20, 2026
```
Signed-off-by: Santino Ramos <elsantinoramos@gmail.com>
```
  85f671b8
- [Bugfix] Disable monolithic TRTLLM MoE for Renormalize routing (#37591) (#37605) · 4f16ebbb
  Vadim Gimpelson authored Mar 20, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4f16ebbb
- [compile] Initialize passes at VllmBackend init (#35216) · 12fd17eb
  Angela Yi authored Mar 20, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
```
  12fd17eb
- [Model] Update Kimi-K25 and Isaac processors to fit HF-style (#37693) · 37aadf62
  Cyrus Leung authored Mar 21, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  37aadf62
- [Bugfix] Disable --calculate-kv-scales for hybrid GDN/Mamba+Attention… (#37565) · d7d2b5e4
  Le Yang authored Mar 21, 2026
```
Signed-off-by: Young-Leo <562593859@qq.com>
```
  d7d2b5e4
- refactor: abstract deepgemm support into platform (#37519) · 6ec5e9fd
  SherryC41 authored Mar 21, 2026
```
Co-authored-by: sherryC41 <sherry.c.c41@gmail.com>
```
  6ec5e9fd
- [Attention] Support distinguishing between short extends and decodes (#37303) · e1d85e5c
  Lucas Wilkinson authored Mar 20, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  e1d85e5c
- fix CUDAGraph memory being counted twice (#37426) · 79eb9369
  Peter Pan authored Mar 21, 2026
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
Signed-off-by: Peter Pan <peter.pan@daocloud.io>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
```
  79eb9369
- [MRV2] Avoid recompilation of _gather_block_tables_kernel (#37645) · e80cfe57
  Woosuk Kwon authored Mar 20, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  e80cfe57
- [Perf] Eliminate redundant SparseMatrix creation in gpt_oss_triton_kernels (#37683) · d0532bf3
  Xin Yang authored Mar 20, 2026
```
Signed-off-by: Xin Yang <xyangx@amazon.com>
```
  d0532bf3
- Fix various config related issues for Transformers v5 (#37681) · 6ade4bc5
  Harry Mellor authored Mar 20, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6ade4bc5
- [compile] Add compiled artifact counter for VLLM_USE_MEGA_AOT_ARTIFACT=1. (#37589) · 2e089b96
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  2e089b96
- [Metrics] Some small refactoring for better maintainability (#33898) · 880be2b1
  Martin Hickey authored Mar 20, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  880be2b1
- [compile] Fix aot test failures with torch 2.12. (#37604) · c0f5fae6
  Zhengxu Chen authored Mar 20, 2026
```
Signed-off-by: zhxchen17 <zhxchen17@fb.com>
```
  c0f5fae6
- [Pixtral] Enable Pixtral language model support Eagle3 (#37182) · aa84e43c
  Rémi Delacourt authored Mar 20, 2026
```
Signed-off-by: remi <remi@mistral.ai>
```
  aa84e43c
- [Bugfix] Fix ConchLinearKernel channelwise quantization (group_size=-1) (#37329) · 5e806bcf
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  5e806bcf
- [Bugfix] Reject channelwise quantization (group_size <= 0) in ExllamaLinearKernel (#37331) · 56a62c31
  Matthias Gehre authored Mar 20, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  56a62c31
- [ROCm] Enable wvSplitK skinny GEMM kernel for RDNA4/gfx1x decode (#34709) · 1779c098
  L.B.R. authored Mar 20, 2026
```
Signed-off-by: L.B.R. <lbr@mmonad.com>
Co-authored-by: L.B.R. <lbr@mmonad.com>
```
  1779c098
- [ROCm][Quantization] make quark ocp mx dtype parser robust for weight-only quantization (#36232) · 44eea10f
  xuebwang-amd authored Mar 20, 2026
```
Signed-off-by: xuebwang-amd <xuebwang@amd.com>
```
  44eea10f
- [Model] Add LFM2-ColBERT-350M support (#37528) · 8b6c6b95
  Ilya Boytsov authored Mar 20, 2026
```
Signed-off-by: Ilya Boytsov <ilyaboytsov1805@gmail.com>
```
  8b6c6b95