Commits · a1a3523a5647a58e00096ca7430e9f1ad4a50a97 · OpenDAS / vllm_cscc

"...trtllm/engine_configs/qwen2-vl-7b-instruct/encode.yaml" did not exist on "d537378a1f553da07cdd3b2a7c679ac771ef803a"

11 Mar, 2026 40 commits
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- fix: align lfm2 thumbnail token counting with HF (#36707) · 741f4e04
  tianshu-Michael-yu authored Mar 11, 2026
  
  741f4e04
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix negative max_tokens when input prompt is too long (#36789) · c84b519c
  Isotr0py authored Mar 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c84b519c
- [Bugfix] Fix DP/EP Shared Expert With Monolithic Kernels (#36061) · b7e5a588
  Robert Shaw authored Mar 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b7e5a588
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf
  Hongxin Xu authored Mar 11, 2026
```
Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  bea02cdf
- Add 'none' reasoning effort to ChatCompletionRequest (#36238) · a3ea760e
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a3ea760e
- Add support to Mistral large 3 eagle with dense layers (#36163) · afebeffb
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  afebeffb
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- [Model Runner V2] Remove unused warmup_for_prefill method (#36762) · 8ccbcda5
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  8ccbcda5
- [ROCm][Perf] Allow MTP lens > 1 in Sparse MLA (#36681) · a9e532af
  tvirolai-amd authored Mar 11, 2026
```
Signed-off-by: Teemu Virolainen <teemu.virolainen@amd.com>
```
  a9e532af
- [Misc] Use envs module to get VLLM_DISABLED_KERNELS (#35776) · 700a1ddc
  Martin Hickey authored Mar 11, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  700a1ddc
- Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
  Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
  e584dce5
- [openapi] refactor render related openapi [3/N] (#36749) · 40c0461f
  Ning Xie authored Mar 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  40c0461f
- [Bugfix] Fix Qwen3-VL timestamp mismatch when using num_frames without fps (#36136) · 72475968
  Weiguang Li authored Mar 11, 2026
```
Signed-off-by: OiPunk <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  72475968
- Disable cascade attention by default (#36318) · 9c34e9d2
  Michael Goin authored Mar 11, 2026
  
  9c34e9d2
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
- fix(lora): use replaced_module_name in pooling model name check (#36402) · c87fb515
  Ethan T. authored Mar 11, 2026
```
Signed-off-by: gambletan <ethanchang32@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  c87fb515
- platforms: Fix Ray DP startup crash (#36665) · 5353c9b0
  Itay Alroy authored Mar 11, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  5353c9b0
- Add: Eagle3 support for Qwen3.5 (#36658) · 9d07a3d6
  Rahul Tuli authored Mar 11, 2026
```
Signed-off-by: Rahul-Tuli <rtuli@redhat.com>
```
  9d07a3d6
- [Refactor] Remove Molmo2 processor wrapper (#36667) · 646b8554
  Cyrus Leung authored Mar 11, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  646b8554
- fix(minicpmv): fix audio inference by handling meta device in init_re… (#36751) · 4286cc5e
  tc-mb authored Mar 11, 2026
```
Signed-off-by: caitianchi <caitianchi@modelbest.cn>
```
  4286cc5e
- [Bugfix] Support other quantization methods in glm41v (#36321) · 545d18d8
  LoganJane authored Mar 11, 2026
```
Signed-off-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: g00887675/loganJane <g00887675/loganJane73@hotmail.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  545d18d8
- [NemotronH] Small fix reasoning parser (#36635) · e661b9ee
  roikoren755 authored Mar 11, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  e661b9ee
- [XPU]Bug fix for some unexpected error when use AgRs backend on XPU device. (#36593) · c910eeb1
  YiSheng5 authored Mar 11, 2026
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  c910eeb1
- Remove unused config field from Gemma2 (#36672) · f4ae58b3
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f4ae58b3
- [UX] Infer dtype for local checkpoint (#36218) · e568cf88
  Isotr0py authored Mar 11, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  e568cf88
- [NIXL][1/N] Refactor `kernel_block_size` detection (#35752) · 098d8447
  Nicolò Lucchesi authored Mar 11, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  098d8447
- [Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to... · a40ee486
  JartX authored Mar 11, 2026
```
[Bugfix] Add Multiple of 16 block_size to triton fallback on rocm Attention to support qwen3_5 (#35923)
Signed-off-by: JartX <sagformas@epdcenter.es>
Co-authored-by: akaratza <akaratza@amd.com>
Co-authored-by: TJian <tunjian.tan@embeddedllm.com>
```
  a40ee486
- AITER MLA backend: Avoid CPU sync in _build_decode (#35765) · eac2dc2b
  pschlan-amd authored Mar 11, 2026
```
Signed-off-by: Patrick Schlangen <pschlan@amd.com>
```
  eac2dc2b
- [Refactor] Remove deadcode in Responses API serving (#36726) · d5080aea
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d5080aea
- [Hardware][NIXL] set default kv buffer type for different platform (#36438) · f22d6e02
  liuzhenwei authored Mar 11, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f22d6e02
- [XPU] Support block fp8 moe by fallback to TritonExpert on XPU (#36458) · 76c6e6da
  Kunshang Ji authored Mar 11, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  76c6e6da
- feat: add RISC-V support for CPU backend (v2) (#36578) · 41846537
  typer-J authored Mar 11, 2026
```
Signed-off-by: typer-J <2236066784@qq.com>
Co-authored-by: Li, Jiang <jiang1.li@intel.com>
```
  41846537
- feat(spec_decode): fuse EAGLE step slot mapping and metadata updates (#33503) · 4aaaf8c8
  Sladyn authored Mar 10, 2026
```
Signed-off-by: sladynnunes <snunes@usc.edu>
```
  4aaaf8c8
- [Doc] Fix duplicate words in comments (#36713) · 4bf53362
  Hongbin Guo authored Mar 11, 2026
```
Signed-off-by: Hongbin10 <jdmjdm1998@163.com>
```
  4bf53362
- [Misc][Attention] Clean up unused method in `CPU_ATTN` (#36673) · 5f77ef15
  Matthew Bonanni authored Mar 11, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  5f77ef15
- [Fix] Use torch.empty for output in attention+quant fusion (#31785) · 7d6abdd0
  elvischenv authored Mar 11, 2026
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  7d6abdd0