Commits · fff3711a244dd9e2915323e31c20768d922e90b5 · OpenDAS / vllm_cscc

"vllm/vscode:/vscode.git/clone" did not exist on "ba0bfd40e21cacfd5da6a1e43028a37258a29cb4"

09 Mar, 2026 10 commits
- [Frontend][2/n] Improve pooling entrypoints | embed. (#36110) · fff3711a
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
```
  fff3711a
- [Bugfix] Skip out-of-stage layers in get_layers_from_vllm_config for pipeline parallel (#36243) · c4d859c2
  Tushar Shetty authored Mar 09, 2026
```
Signed-off-by: Tushar Shetty <tushar.shetty@abbyy.com>
Signed-off-by: Tushar Shetty <54362365+tusharshetty61@users.noreply.github.com>
```
  c4d859c2
- feat(attention): extract KV-cache update from FlexAttention backend (#36263) · 74743104
  cong-or authored Mar 09, 2026
```
Signed-off-by: cong-or <conchubhar.gannon@gmail.com>
```
  74743104
- [Misc] Move processors to `transformers_utils` (#35953) · d62856b9
  Cyrus Leung authored Mar 09, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d62856b9
- Increase Flexibility for OOV Multimodal Token Handling (#34858) · bd2659a5
  Alex Brooks authored Mar 08, 2026
```
Signed-off-by: Alex Brooks <albrooks@redhat.com>
```
  bd2659a5
- fix: Use iterator as not to store all the file loads in memory at once (#36149) · 90512b2e
  Shaun Kotek authored Mar 09, 2026
```
Signed-off-by: Shaun Kotek - Nvidia <skotek@nvidia.com>
```
  90512b2e
- [Examples][1/n] Resettle basic examples. (#35579) · dcf8862f
  wang.yuqi authored Mar 09, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
Signed-off-by: wang.yuqi <noooop@126.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  dcf8862f
- [Bugfix] Fix CPU OMP autobind assertion to use local_world_size (#35815) · 43aa3892
  Weiguang Li authored Mar 09, 2026
```
Signed-off-by: liweiguang <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  43aa3892
- Allow `markdownlint` to run locally (#36398) · a0f44bb6
  Harry Mellor authored Mar 09, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a0f44bb6
- [cudagraph] fix cudagraph warning in deepseekv32 (#28044) · e5ff1402
  Jiangyun Zhu authored Mar 09, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  e5ff1402
08 Mar, 2026 3 commits
- Add support for ModelOpt MXFP8 MoE models (#35986) · 0a6a3a12
  danisereb authored Mar 08, 2026
```
Signed-off-by: Daniel Serebrenik <daserebrenik@nvidia.com>
```
  0a6a3a12
- [Frontend] Add GPU-less render serving path (`vllm launch render`) (#36166) · 4497431d
  Sage authored Mar 08, 2026
  
  4497431d
- [Model] Nano Nemotron VL - fast media preprocessing (#35657) · b7332b05
  nvnbagrov authored Mar 08, 2026
```
Signed-off-by: Natan Bagrov <nbagrov@nvidia.com>
```
  b7332b05
07 Mar, 2026 17 commits
- [LMCache MP Patch]: Race Condition + Duplicated Block Ids (#35831) · 5d6aae45
  Samuel Shen authored Mar 07, 2026
  
  5d6aae45
- [Bugfix][LMCache][KVConnector] fix potential memory leak in LMCache multiprocess mode (#35931) · 63298ee1
  Roy Huang authored Mar 07, 2026
  
  63298ee1
- [compile] Split compile/warmup monitoring (#36098) · 2dde535d
  Richard Zou authored Mar 07, 2026
  
  2dde535d
- [Perf] Support FP8 KV cache for Flashinfer MLA Sparse (#35891) · 379689d5
  Wei Zhao authored Mar 07, 2026
  
  379689d5
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
- [UX][Startup] Account for CUDA graphs during memory profiling (#30515) · ebb9cc5f
  Matthew Bonanni authored Mar 07, 2026
  
  ebb9cc5f
- Adding support to Sarvam's MoE models (#33942) · 85f50eb4
  rahul-sarvam authored Mar 08, 2026
```
Signed-off-by: rahul-sarvam <140298821+rahul-sarvam@users.noreply.github.com>
```
  85f50eb4
- [Misc] Remove duplicate parser registration (#36303) · 5261223c
  Taneem Ibrahim authored Mar 07, 2026
```
Signed-off-by: Taneem Ibrahim <taneem.ibrahim@gmail.com>
```
  5261223c
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
- [Bugfix] Fix compressed-tensors quantization failure for DeepSeek-R1 on MI300x (#36247) · ee8a2951
  vllmellm authored Mar 07, 2026
```
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>
```
  ee8a2951
- feat: expose media_io_kwargs at runtime (#34778) · 755356b3
  milesial authored Mar 06, 2026
```
Signed-off-by: Alexandre Milesi <milesial@users.noreply.github.com>
```
  755356b3
- Fix CUDA graph decode capture crash in AITER FlashAttention (#36042) · 1a971808
  Mengtao (Martin) Yuan authored Mar 06, 2026
```
Signed-off-by: Martin Yuan <myuan@meta.com>
Co-authored-by: Martin Yuan <myuan@meta.com>
```
  1a971808
- refine `vllm bench throughput --backend hf` (#35971) · 7eb524e6
  Kunshang Ji authored Mar 07, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  7eb524e6
- [BugFix] Avoid ignored trust_remote_code warnings (#36290) · c7f32e08
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  c7f32e08
- [Model Runner V2] Fix warmup for pipeline parallel (#36280) · b3546865
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  b3546865
- [Core] Fix benign error log during normal shutdown (#36270) · 6a18d878
  Nick Hill authored Mar 06, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  6a18d878
- mla: don't update kv cache on dummy forwards (#36282) · 24a03915
  Itay Alroy authored Mar 07, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  24a03915
06 Mar, 2026 10 commits

[docs][torch.compile] Add fusions.md — kernel/operator fusion reference page (#35538) · ce8546a1

Copilot authored Mar 06, 2026

Signed-off-by: ProExpertProg <luka.govedic@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
Co-authored-by: ProExpertProg <luka.govedic@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

ce8546a1

[ROCm] Support MLA with nhead<16 and FP8 KV cache for TP=8 (Kimi K2.5/Linear) (#35850) · c188749b
Chuan (Richard) Li authored Mar 06, 2026
```
Signed-off-by: Li <chuali@amd.com>
```
c188749b

[CustomOp] CustomOp FusedRMSNormGated (#35877) · f3c6c9c9

eellison authored Mar 06, 2026


Signed-off-by: Elias Ellison <elias.ellison@gmail.com>
Signed-off-by: eellison <elias.ellison@gmail.com>

f3c6c9c9

Revert "[BugFix] Fix engine hanging after KV cache initialization fai… (#36262) · 26bd43b5
Nick Hill authored Mar 06, 2026

26bd43b5

[Bugfix] Quickfix followups to busy loop removal in #28053 (#36068) · 6b625a88

Travis Johnson authored Mar 06, 2026


Signed-off-by: Travis Johnson <tsjohnso@us.ibm.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

6b625a88

[compile] Stop unconditionally patching constrain_to_fx_strides (#36152) · 54756b61
Richard Zou authored Mar 06, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
54756b61
[Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact... · 39f9ea0d
Raphaël Rialland authored Mar 06, 2026
```
[Bugfix] Fix `cudagraph_mode:FULL` dispatch (This does not impact `FULL_AND_PIECEWISE` (default)) (#36165)
```
39f9ea0d
[Refactor] Modular video loader backend refactoring (#35202) · e4ae148a
Isotr0py authored Mar 06, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
e4ae148a

[Misc] Lazy import registered processors (#36024) · 1d0c0d20

Isotr0py authored Mar 06, 2026


Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Roger Wang <hey@rogerw.io>

1d0c0d20

[bugfix] add api process rank in default multimodal request (#36150) · fcb73f30
Chenguang Zheng authored Mar 06, 2026
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: Chenguang ZHENG <645327136@qq.com>
```
fcb73f30