Commits · e39257a552d18ae9abb6ba1bbe65865d385ea764 · OpenDAS / vllm_cscc · GitLab

12 Mar, 2026 32 commits
- Add `AGENTS.md` (#36877) · e39257a5
  Harry Mellor authored Mar 12, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  e39257a5
- Update Flashinfer to 0.6.6 (#36768) · cc16b24b
  Dimitrios Bariamis authored Mar 12, 2026
```
Signed-off-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
Co-authored-by: Dimitrios Bariamis <12195802+dbari@users.noreply.github.com>
```
  cc16b24b
- [Bugfix] Fix KeyError in parse_response_input for reasoning items with optional content (#34499) · bdc23434
  Eunkwang Jeon authored Mar 13, 2026
```
Signed-off-by: jeonsworld <jeonsworld@gmail.com>
```
  bdc23434
- [Attention] Use FA4 for MLA prefill (#34732) · f444c05c
  Matthew Bonanni authored Mar 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  f444c05c
- [Bugfix] fix main branch pre-commit error (1 line change) (#36897) · 85199f96
  SoluMilken authored Mar 13, 2026
```
Signed-off-by: SoluMilken <ypiheyn.imm02g@g2.nctu.edu.tw>
```
  85199f96
- [Kernel] Add FP8 KV cache support to Triton MLA decode attention (#34597) · a1257fd1
  grimulkan authored Mar 12, 2026
```
Signed-off-by: grimulkan <grimulkan@gmail.com>
```
  a1257fd1
- [CI] Fix mypy pre-commit errors on main (#36882) · abcffbba
  Thomas Parnell authored Mar 12, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  abcffbba
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [Perf] Add TRTLLM FP8 MoE Modular Kernel (#36307) · 2e693f48
  Wei Zhao authored Mar 12, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  2e693f48
- [CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf
  Martin Hickey authored Mar 12, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7f1f36bf
- [docs] Add lightweight AI assisted contribution policy (#30947) · 5282c7d4
  Mark McLoughlin authored Mar 12, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  5282c7d4
- [Perf] add packed recurrent fast path for decode (#36596) · 9e19f833
  caozuoba authored Mar 12, 2026
```
Signed-off-by: hdj <1293066020@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
```
  9e19f833
- [Frontend] Split `OpenAIServingModels` into `OpenAIModelRegistry` + `OpenAIServingModels` (#36536) · 06e0bc21
  Sage authored Mar 12, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  06e0bc21
- [Bugfix] Fix crash when tool_choice=required exceeds max_tokens (#36841) · 5a71cdd7
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  5a71cdd7
- [MM][OOT] Support CPU `seq_lens` for OOT MMEncoderAttention kernels (#36605) · f0d3658c
  Shanshan Shen authored Mar 12, 2026
```
Signed-off-by: shen-shanshan <467638484@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  f0d3658c
- [UX] Only show FP4 Marlin fallback warning for w4a4 models (#36806) · 57431d82
  Michael Goin authored Mar 12, 2026
```
Co-authored-by: Claude <noreply@anthropic.com>
```
  57431d82
- [Bugfix] Warm up Triton autotuner for GDN layers during V1 profiling (#36599) · 3e64fe4a
  Xu Jinyang authored Mar 12, 2026
```
Signed-off-by: AuYang <459461160@qq.com>
```
  3e64fe4a
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
- [Bugfix][Model] Fix DeepSeek-OCR TensorSchema crash on empty images_crop (#36670) · 00726c74
  István Ketykó authored Mar 12, 2026
```
Signed-off-by: István Ketykó <istvan.ketyko@gmail.com>
```
  00726c74
- [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) · 9fe404ed
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9fe404ed
- [Tests] Skip model weight download for render-only test server (#36813) · 802f306c
  Sage authored Mar 12, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  802f306c
- replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
  Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  894843eb
- [Kernel][Helion][13/N] Force static_shapes=False in helion register (#36677) · 584a3f56
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  584a3f56
- [BugFix] Fix multiple/duplicate stdout prefixes (#36822) · 36735fd7
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  36735fd7
- [CI Failure] Fix Language Models Test (Extended Pooling) daily CI Failure (#36761) · 6ecabe49
  wang.yuqi authored Mar 12, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  6ecabe49
- [Model Runner V2] Do not initialize sampler for non-last PP ranks (#36824) · 2f8b4ce0
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  2f8b4ce0
- [LMCache] Fault Tolerance Mechanism (#36586) · 2ef69456
  Yuwei An authored Mar 11, 2026
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  2ef69456
- more models for vLLM Benchmark Suite (#35086) · 17852aa5
  Louie Tsai authored Mar 11, 2026
```
Signed-off-by: louie-tsai <louie.tsai@intel.com>
```
  17852aa5
- [Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895) · 8647c6cf
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  8647c6cf
- [XPU][Doc] Remove manual OneAPI install step, now handled by torch-xpu (#36831) · 513949f9
  Kunshang Ji authored Mar 12, 2026
```
Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
```
  513949f9
- [Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  262b76a0
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 8 commits
- [ROCm][CI/Build] Add gfx1152/gfx1153 (Krackan) to HIP supported architectures (#36499) · 24062b70
  Matthias Gehre authored Mar 12, 2026
```
Signed-off-by: Matthias Gehre <matthias.gehre@amd.com>
```
  24062b70
- [BUG] Fix async rlhf tests (#35811) · d6b61e51
  Aaron Hao authored Mar 11, 2026
```
Signed-off-by: ahao-anyscale <ahao@anyscale.com>
```
  d6b61e51
- [Kernel] [Helion] [15/N] Split config files into per-platform files (#36698) · cf632499
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  cf632499
- [Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during... · a3774a81
  Yanan Cao authored Mar 11, 2026
```
[Kernel] [Helion] [12/N] Use FakeTensorMode to avoid GPU allocation during config key computation (#36563)
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  a3774a81
- [Kernel] [Helion] [14/N] Set autotune_ignore_errors=True during autotuning (#36683) · 0ce21c46
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  0ce21c46
- [Model Runner V2] Add WhisperModelState [6/N] (#35790) · 55eed6b7
  Woosuk Kwon authored Mar 11, 2026
```
Signed-off-by: Woosuk Kwon <woosuk@inferact.ai>
```
  55eed6b7
- [Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
  Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
  c77181e5
- [LMCache] Pass TP size in lookup for MLA multi-reader locking (#36129) · 12001f2e
  maobaolong authored Mar 12, 2026
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  12001f2e