Commits · 00726c74c9d97d3e85e347211386ee95bccf38de · OpenDAS / vllm_cscc · GitLab

12 Mar, 2026 8 commits
- [Bugfix][Model] Fix DeepSeek-OCR TensorSchema crash on empty images_crop (#36670) · 00726c74
  István Ketykó authored Mar 12, 2026
```
Signed-off-by: István Ketykó <istvan.ketyko@gmail.com>
```
  00726c74
- [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) · 9fe404ed
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9fe404ed
- [Tests] Skip model weight download for render-only test server (#36813) · 802f306c
  Sage authored Mar 12, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  802f306c
- [Kernel][Helion][13/N] Force static_shapes=False in helion register (#36677) · 584a3f56
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  584a3f56
- [CI Failure] Fix Language Models Test (Extended Pooling) daily CI Failure (#36761) · 6ecabe49
  wang.yuqi authored Mar 12, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  6ecabe49
- [Bugfix] Fix minimax_m2 tool parser when stream interval > 1 (#35895) · 8647c6cf
  Flora Feng authored Mar 11, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  8647c6cf
- [Frontend] Exclude anthropic billing header to avoid prefix cache miss (#36829) · 262b76a0
  Nick Hill authored Mar 11, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  262b76a0
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 22 commits
- [Kernel] [Helion] [15/N] Split config files into per-platform files (#36698) · cf632499
  Yanan Cao authored Mar 11, 2026
```
Signed-off-by: Yanan Cao <gmagogsfm@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  cf632499
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- Make Gemma and Gemma 2 accept `inputs_embeds` like Gemma 3 (#36787) · 65986db6
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  65986db6
- [torch.compile] Add support for non-contiguous fused RMSNorm + group quant (#36551) · 9556af87
  Luka Govedič authored Mar 11, 2026
```
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Copilot <198982749+Copilot@users.noreply.github.com>
Co-authored-by: ProExpertProg <11367180+ProExpertProg@users.noreply.github.com>
```
  9556af87
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- Add 320 dimension size support to MLA (#36161) · a5d06dc5
  Julien Denize authored Mar 11, 2026
```
Signed-off-by: Julien Denize <julien.denize@mistral.ai>
```
  a5d06dc5
- Fix `ExaoneMoeMTP` test that never ran in Transformers v4 (#36792) · 5efa206a
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5efa206a
- [Misc] Clean up renderers (#36770) · 196802df
  Cyrus Leung authored Mar 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  196802df
- [Bugfix] Fix negative max_tokens when input prompt is too long (#36789) · c84b519c
  Isotr0py authored Mar 12, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  c84b519c
- [torch.compile] Use FakeTensors instead of real GPU tensors for single-size compilation (#36093) · 822e250a
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  822e250a
- Kimi k2.5 MLA based eagle3 (#36361) · 55738947
  Jhao-Ting Chen authored Mar 11, 2026
```
Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>
```
  55738947
- Fix tied weights in weight mapping test for Transformers v5 (#36788) · d5816c8c
  Harry Mellor authored Mar 11, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d5816c8c
- Add XPU MLA Sparse backend for DeepSeek v3.2 (#33230) · e584dce5
  Wuxun Zhang authored Mar 11, 2026
```
Signed-off-by: Zhang, Wuxun <wuxun.zhang@intel.com>
```
  e584dce5
- [Bugfix] Fix Qwen3-VL timestamp mismatch when using num_frames without fps (#36136) · 72475968
  Weiguang Li authored Mar 11, 2026
```
Signed-off-by: OiPunk <codingpunk@gmail.com>
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  72475968
- [compile] aot_compile should respect VLLM_DISABLE_COMPILE_CACHE (#36358) · 09b6f998
  Richard Zou authored Mar 11, 2026
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  09b6f998
- [ci] Update rtol for test_classification (#36556) · 13e79fc8
  Angela Yi authored Mar 11, 2026
```
Signed-off-by: angelayi <yiangela7@gmail.com>
Co-authored-by: Richard Zou <zou3519@users.noreply.github.com>
```
  13e79fc8
- [NemotronH] Small fix reasoning parser (#36635) · e661b9ee
  roikoren755 authored Mar 11, 2026
```
Signed-off-by: Roi Koren <roik@nvidia.com>
```
  e661b9ee
- [NIXL][1/N] Refactor `kernel_block_size` detection (#35752) · 098d8447
  Nicolò Lucchesi authored Mar 11, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  098d8447
- feat(spec_decode): fuse EAGLE step slot mapping and metadata updates (#33503) · 4aaaf8c8
  Sladyn authored Mar 10, 2026
```
Signed-off-by: sladynnunes <snunes@usc.edu>
```
  4aaaf8c8
- [Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781) · a8ff2cca
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  a8ff2cca
- [Model] Add support for moonshotai/Kimi-Audio-7B-Instruct (#36127) · 42fadebe
  tunglinwood authored Mar 11, 2026
```
Signed-off-by: tunglinwood <tunglinwood@gmail.com>
Signed-off-by: tunglinwood <tomwu.tunglin@gmail.com>
Signed-off-by: tunglinwood <113751333+tunglinwood@users.noreply.github.com>
```
  42fadebe
- [openapi server] log exception in exception handler(2/N) (#36201) · fe714dd5
  Ning Xie authored Mar 11, 2026
```
Signed-off-by: Andy Xie <andy.xning@gmail.com>
```
  fe714dd5
10 Mar, 2026 10 commits
- [Core] Simplify core kv-cache blocks initialization logic (#36521) · 65b2f405
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  65b2f405
- [Test] `test_async_scheduling.py` improvements (#36340) · 2a68464c
  Nick Hill authored Mar 10, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  2a68464c
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
- Improvements to wvSplitKrc skinny GEMM solution (#34304) · 721ae79f
  Hashem Hashemi authored Mar 10, 2026
```
Signed-off-by: Hashem Hashemi <hashem.hashemi@amd.com>
```
  721ae79f
- feat(kv-offload): Strategy A — StoreReusedOffloadingManager gates CPU stores... · 106ff69c
  Srinivasoo7 authored Mar 10, 2026
```
feat(kv-offload): Strategy A — StoreReusedOffloadingManager gates CPU stores on reuse frequency (#35342)
Signed-off-by: srinivas_oo7 <Sriusa4414@gmail.com>
Signed-off-by: Sriusa4414@gmail.com
Signed-off-by: Srinivasoo7 <158864704+Srinivasoo7@users.noreply.github.com>
Co-authored-by: srinivas_oo7 <sklinkedin0120@gmail.com>
Co-authored-by: Srinivasoo7 <158864704+Srinivasoo7@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  106ff69c
- [Bugfix] Avoid merging empty-only partitions into splitting-op subgraphs (#36595) · ca5fb4bb
  Jiangyun Zhu authored Mar 10, 2026
```
Signed-off-by: zjy0516 <riverclouds.zhu@qq.com>
```
  ca5fb4bb
- [Model] Consolidate score logic by introduce score_type (#36479) · a3189a08
  wang.yuqi authored Mar 10, 2026
```
Signed-off-by: wang.yuqi <yuqi.wang@daocloud.io>
```
  a3189a08
- [Frontend][Core] Revert "Add shutdown timeout" (#34730 and #36270) (#36628) · 23486039
  Mark McLoughlin authored Mar 10, 2026
```
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
```
  23486039
- Fix Qwen2.5-VL test for Transformers v5 (#36532) · c8851008
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  c8851008
- feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc... · 507ddbe9
  Chang Su authored Mar 10, 2026
```
feat(grpc): extract gRPC servicer into smg-grpc-servicer package, add --grpc flag to vllm serve (#36169)
Signed-off-by: Chang Su <chang.s.su@oracle.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  507ddbe9