Commits · 802f306cd116c575dd1db6d8dd9c37751916017b · OpenDAS / vllm_cscc · GitLab

12 Mar, 2026 12 commits
- [Tests] Skip model weight download for render-only test server (#36813) · 802f306c
  Sage authored Mar 12, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  802f306c
- replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
  Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  894843eb
- [Kernel][Helion][13/N] Force static_shapes=False in helion register (#36677) · 584a3f56
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  584a3f56
- [BugFix] Fix multiple/duplicate stdout prefixes (#36822) · 36735fd7
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  36735fd7
- [CI Failure] Fix Language Models Test (Extended Pooling) daily CI Failure (#36761) · 6ecabe49
  wang.yuqi authored Mar 12, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  6ecabe49
- [Model Runner V2] Do not initialize sampler for non-last PP ranks (#36824) · 2f8b4ce0
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f8b4ce0
- [LMCache] Fault Tolerance Mechanism (#36586) · 2ef69456
  Yuwei An authored Mar 11, 2026
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  2ef69456
- more models for vLLM Benchmark Suite (#35086) · 17852aa5
  Louie Tsai authored Mar 11, 2026
```
Signed-off-by: louie-tsai <louie.tsai@intel.com>
```
  17852aa5
- [Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895) · 8647c6cf
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  8647c6cf
- [XPU][Doc] Remove manual OneAPI install step, now handled by torch-xpu (#36831) · 513949f9
  Kunshang Ji authored Mar 12, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
  513949f9
- [Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  262b76a0
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 28 commits
- [ROCm][CI/Build] Add gfx1152/gfx1153 (Krackan) to HIP supported architectures (#36499) · 24062b70
  Matthias Gehre authored Mar 12, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  24062b70
- [BUG] Fix async rlhf tests (#35811) · d6b61e51
  Aaron Hao authored Mar 11, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  d6b61e51
- [Kernel] [Helion] [15/N] Split config files into per-platform files (#36698) · cf632499
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  cf632499
- [Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during... · a3774a81
  Yanan Cao authored Mar 11, 2026
```
[Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during config key computation (#36563)
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  a3774a81
- [Kernel] [Helion] [14/N] Set autotune_ignore_errors=True during autotuning (#36683) · 0ce21c46
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  0ce21c46
- [Model Runner V2] Add WhisperModelState [6/N] (#35790) · 55eed6b7
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  55eed6b7
- [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
  Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c77181e5
- [LMCache] Pass TP size in lookup for MLA multi-reader locking (#36129) · 12001f2e
  maobaolong authored Mar 12, 2026
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  12001f2e
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- [Bugfix][ROCm] Strip block_size before attention backend validation (#36274) · 428bc718
  jennyyyyzhen authored Mar 11, 2026
```
Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  428bc718
- [BugFix]: add bagel to MM_PREFIX_LM_MODELS (#36316) · ff1e3d9c
  汪志鹏 authored Mar 12, 2026
```
Signed-off-by: princepride <wangzhipeng628@gmail.com>
```
  ff1e3d9c
- [Refactor] Remove dead code in KV connector (#36424) · 35bdca54
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  35bdca54
- [ROCm] add tuned moe_wna16_triton kernel configs for CDNA4 (#35093) · 8a248427
  Amanzhol Salykov authored Mar 11, 2026
```
Signed-off-by: salykova <amsalykov@gmail.com>
Signed-off-by: amd-asalykov <asalykov@amd.com>
```
  8a248427
- Make Gemma and Gemma 2 accept `inputs_embeds` like Gemma 3 (#36787) · 65986db6
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  65986db6
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- fix: align lfm2 thumbnail token counting with HF (#36707) · 741f4e04
  tianshu-Michael-yu authored Mar 11, 2026
  
  741f4e04
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
- Fix `ExaoneMoeMTP` test that never ran in Transformers v4 (#36792) · 5efa206a
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5efa206a
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix negative max_tokens when input prompt is too long (#36789) · c84b519c
  Isotr0py authored Mar 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c84b519c
- [CI] Add bfcl tool call correctness eval (#36560) · 741ecf06
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
```
  741ecf06
- [Bugfix] Fix DP/EP Shared Expert With Monolithic Kernels (#36061) · b7e5a588
  Robert Shaw authored Mar 11, 2026
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  b7e5a588
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- Fix routed experts capture for hybrid models (Mamba + Attention) (#35744) · bea02cdf
  Hongxin Xu authored Mar 11, 2026
```
Signed-off-by: arlenxu <arlenxu@tencent.com>
Signed-off-by: xhx1022 <1737006628@qq.com>
Co-authored-by: arlenxu <arlenxu@tencent.com>
```
  bea02cdf
- Add 'none' reasoning effort to ChatCompletionRequest (#36238) · a3ea760e
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a3ea760e
- Correct link to supported hardware on vllm.ai (#36798) · 35db669f
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  35db669f
- Add support to Mistral large 3 eagle with dense layers (#36163) · afebeffb
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: juliendenize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  afebeffb