Commits · 4ff8c3c8f9ece010a1d0e376f5cc1b468b95f366 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "872db2be0e8499960cedbbc2fbcbcb2837b53be2"

10 Mar, 2026 5 commits
- [BUGFIX][Mamba][Qwen3.5] Zero freed SSM cache blocks on GPU (#35219) · 4ff8c3c8
  Vadim Gimpelson authored Mar 10, 2026
```
Signed-off-by: Vadim Gimpelson <vadim.gimpelson@gmail.com>
```
  4ff8c3c8
- [Model Runner V2] Fix mm input embeddings lookup (#36588) · ddbb0d23
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  ddbb0d23
- [Model Runner V2] Fix `_compute_slot_mappings_kernel` for chunked prefill (#36580) · 9efc3bdc
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  9efc3bdc
- [Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E... · 7279374f
  Wentao Ye authored Mar 09, 2026
```
[Perf] Compute maxsim in worker side, reducing redundant copies, 2.7% E2E throughput improvement (#36159)
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  7279374f
- [BugFix] Remove incorrect assert in split_decodes_and_prefills (#36553) · 006aea17
  Woosuk Kwon authored Mar 09, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  006aea17
09 Mar, 2026 13 commits
- [Model Runner V2] Add model_state inputs to CUDA graph capture (#36544) · 2a194ddd
  Woosuk Kwon authored Mar 09, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2a194ddd
- [MRV2] Extensible CG dispatch rework (#35959) · 483463f7
  Lucas Wilkinson authored Mar 09, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  483463f7
- [MTP][Misc] Clean up dead code (#36507) · 4e571ce6
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4e571ce6
- [Model Runner V2] Use NamedTuple for `execute_model_state` (#35930) · 10a5f4d5
  Woosuk Kwon authored Mar 09, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  10a5f4d5
- [Model Runner V2] Add dummy profile_cudagraph_memory API (#36520) · 6e956d9e
  Woosuk Kwon authored Mar 09, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  6e956d9e
- [ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes,... · c174d54f
  Andreas Karatzas authored Mar 09, 2026
```
[ROCm][CI] Fix ROCm attention backend validation for head sizes, block sizes, and compute capability checks (#36292)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  c174d54f
- [Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA... · 580864d8
  Roberto L. Castro authored Mar 09, 2026
```
[Attention][Perf][Kernel] Replace torch.cat with vectorized CUDA kernel MLA query concat - DeepSeek-V3.2 (#34917)
Signed-off-by: LopezCastroRoberto <rocastro@redhat.com>
Signed-off-by: Roberto L. Castro <38211239+LopezCastroRoberto@users.noreply.github.com>
```
  580864d8
- [Bugfix] Clear stale CG keys after memory profiling (#36416) · 00c4cb56
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  00c4cb56
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
- [Deprecation][1/2] Remove items deprecated in v0.18 (#36470) · f96c3ab0
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f96c3ab0
- [Bugfix] Avoid to replace non-tensor members in cpu model runner (#36430) · 217f2759
  Li, Jiang authored Mar 09, 2026
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  217f2759
- feat(attention): extract KV-cache update from FlexAttention backend (#36263) · 74743104
  cong-or authored Mar 09, 2026
```
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
```
  74743104
- [Bugfix] Fix CPU OMP autobind assertion to use local_world_size (#35815) · 43aa3892
  Weiguang Li authored Mar 09, 2026
```
Signed-off-by: liweiguang <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  43aa3892
08 Mar, 2026 1 commit
- [Frontend] Add GPU-less render serving path (`vllm launch render`) (#36166) · 4497431d
  Sage authored Mar 08, 2026
  
  4497431d
07 Mar, 2026 6 commits
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
- [UX][Startup] Account for CUDA graphs during memory profiling (#30515) · ebb9cc5f
  Matthew Bonanni authored Mar 07, 2026
  
  ebb9cc5f
- Fix CUDA graph decode capture crash in AITER FlashAttention (#36042) · 1a971808
  Mengtao (Martin) Yuan authored Mar 06, 2026
```
Signed-off-by: Martin Yuan <myuan@meta.com>
Co-authored-by: Martin Yuan <myuan@meta.com>
```
  1a971808
- [Model Runner V2] Fix warmup for pipeline parallel (#36280) · b3546865
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b3546865
- [Core] Fix benign error log during normal shutdown (#36270) · 6a18d878
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  6a18d878
06 Mar, 2026 15 commits
- [ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850) · c188749b
  Chuan (Richard) Li authored Mar 06, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
  c188749b
- Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262) · 26bd43b5
  Nick Hill authored Mar 06, 2026
  
  26bd43b5
- [Bugfix] Quickfix followups to busy loop removal in #28053 (#36068) · 6b625a88
  Travis Johnson authored Mar 06, 2026
```
Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  6b625a88
- [Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact... · 39f9ea0d
  Raphaël Rialland authored Mar 06, 2026
```
[Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact `FULL_AND_PIECEWISE` (default)) (#36165)
```
  39f9ea0d
- [Core][KVConnector] Support HMA+NixlConnector (#35758) · 5b3ba94a
  Nicolò Lucchesi authored Mar 06, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5b3ba94a
- [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158) · 90f3c01f
  zhanqiuhu authored Mar 06, 2026
```
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  90f3c01f
- [ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching,... · 807d6803
  Andreas Karatzas authored Mar 06, 2026
```
[ROCm][CI] Fix tool use test stability - disable skinny GEMM, prefix caching, eliminate batch variance (#35553)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  807d6803
- [Bugfix] Fix inner_dp_world initialization order for multi-node TP (#35892) · 86e1060b
  Yongye Zhu authored Mar 06, 2026
```
Signed-off-by: Yongye Zhu <zyy1102000@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  86e1060b
- [Frontend][Core] Add shutdown timeout - allowing in-flight requests to finish (#34730) · 27066d1b
  Mark McLoughlin authored Mar 06, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Claude Sonnet 4.5 <noreply@anthropic.com>
```
  27066d1b
- perf: add __slots__ to KVCacheBlock (#36164) · 57c84ff1
  cong-or authored Mar 06, 2026
```
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
```
  57c84ff1
- [BugFix] Fix engine hanging after KV cache initialization failure (#35478) · 0a208d1f
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  0a208d1f
- [Feature] Add --distributed-timeout-seconds CLI option (#36047) · 03a49bb8
  Shiyan Deng authored Mar 05, 2026
```
Signed-off-by: Shiyan Deng <dsy842974287@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  03a49bb8
- [Misc] Rename `group_mm_kwargs_by_modality -> group_and_batch_mm_kwargs` (#36158) · 6dd30265
  Cyrus Leung authored Mar 06, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  6dd30265
- Reenable features for ROCm attention backends (#36185) · c5362c73
  Rohan Potdar authored Mar 05, 2026
```
Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>
```
  c5362c73
- [Performance] Extract KV-cache update from TreeAttention backend (#35384) · ebed80a7
  Dor Huri authored Mar 06, 2026
```
Signed-off-by: dorhuri123 <dor.huri1@live.biu.ac.il>
```
  ebed80a7