Commits · 262b76a09fafe15cff7642f3eee433fb903cf1d8 · OpenDAS / vllm_cscc · GitLab

12 Mar, 2026 2 commits
- [Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  262b76a0
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 38 commits
- [ROCm][CI/Build] Add gfx1152/gfx1153 (Krackan) to HIP supported architectures (#36499) · 24062b70
  Matthias Gehre authored Mar 12, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  24062b70
- [BUG] Fix async rlhf tests (#35811) · d6b61e51
  Aaron Hao authored Mar 11, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  d6b61e51
- [Kernel] [Helion] [15/N] Split config files into per-platform files (#36698) · cf632499
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  cf632499
- [Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during... · a3774a81
  Yanan Cao authored Mar 11, 2026
```
[Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during config key computation (#36563)
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  a3774a81
- [Kernel] [Helion] [14/N] Set autotune_ignore_errors=True during autotuning (#36683) · 0ce21c46
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  0ce21c46
- [Model Runner V2] Add WhisperModelState [6/N] (#35790) · 55eed6b7
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  55eed6b7
- [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
  Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c77181e5
- [LMCache] Pass TP size in lookup for MLA multi-reader locking (#36129) · 12001f2e
  maobaolong authored Mar 12, 2026
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  12001f2e
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- [Bugfix][ROCm] Strip block_size before attention backend validation (#36274) · 428bc718
  jennyyyyzhen authored Mar 11, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  428bc718
- [BugFix]: add bagel to MM_PREFIX_LM_MODELS (#36316) · ff1e3d9c
  汪志鹏 authored Mar 12, 2026
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  ff1e3d9c
- [Refactor] Remove dead code in KV connector (#36424) · 35bdca54
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  35bdca54
- [ROCm] add tuned moe_wna16_triton kernel configs for CDNA4 (#35093) · 8a248427
  Amanzhol Salykov authored Mar 11, 2026
```
Signed-off-by: salykova <amsalykov@gmail.com>
Signed-off-by: amd-asalykov <asalykov@amd.com>
```
  8a248427
- Make Gemma and Gemma 2 accept `inputs_embeds` like Gemma 3 (#36787) · 65986db6
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  65986db6
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- fix: align lfm2 thumbnail token counting with HF (#36707) · 741f4e04
  tianshu-Michael-yu authored Mar 11, 2026
  
  741f4e04
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
- Fix `ExaoneMoeMTP` test that never ran in Transformers v4 (#36792) · 5efa206a
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5efa206a
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix negative max_tokens when input prompt is too long (#36789) · c84b519c
  Isotr0py authored Mar 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c84b519c
- [CI] Add bfcl tool call correctness eval (#36560) · 741ecf06
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  741ecf06
- [Bugfix] Fix DP/EP Shared Expert With Monolithic Kernels (#36061) · b7e5a588
  Robert Shaw authored Mar 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b7e5a588
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf
  Hongxin Xu authored Mar 11, 2026
```
Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  bea02cdf
- Add 'none' reasoning effort to ChatCompletionRequest (#36238) · a3ea760e
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a3ea760e
- Correct link to supported hardware on vllm.ai (#36798) · 35db669f
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  35db669f
- Add support to Mistral large 3 eagle with dense layers (#36163) · afebeffb
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  afebeffb
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- Fix tied weights in weight mapping test for Transformers v5 (#36788) · d5816c8c
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d5816c8c
- [Model Runner V2] Remove unused warmup_for_prefill method (#36762) · 8ccbcda5
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  8ccbcda5
- [ROCm][Perf] Allow MTP lens > 1 in Sparse MLA (#36681) · a9e532af
  tvirolai-amd authored Mar 11, 2026
```
Signed-off-by: Teemu Virolainen <teemu.virolainen@amd.com>
```
  a9e532af
- Disable docs build skipping until a better solution is found (#36790) · f3163bba
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f3163bba
- [Misc] Use envs module to get VLLM_DISABLED_KERNELS (#35776) · 700a1ddc
  Martin Hickey authored Mar 11, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  700a1ddc
- [Bugfix] Fix Mistral-small `--format` (#36782) · f33251ff
  Silvia Colabrese authored Mar 11, 2026
```
Signed-off-by: 12010486 <silvia.colabrese@intel.com>
```
  f33251ff
- Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
  Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
  e584dce5
- [openapi] refactor render related openapi [3/N] (#36749) · 40c0461f
  Ning Xie authored Mar 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  40c0461f
- [Bugfix] Fix Qwen3-VL timestamp mismatch when using num_frames without fps (#36136) · 72475968
  Weiguang Li authored Mar 11, 2026
```
Signed-off-by: OiPunk <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  72475968