Commits · 6050b93bedb66a086281c160814b3cfca8da3111 · OpenDAS / vllm_cscc · GitLab

20 Mar, 2026 2 commits
- [V0 Deprecation] Deprecate --disable-frontend-multiprocessing (#37612) · 9040151f
  Flora Feng authored Mar 19, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  9040151f
- fix: disambiguate multimodal prefix cache keys (#36708) · 269bf46d
  tianshu-Michael-yu authored Mar 19, 2026
```
Signed-off-by: tianshu.yu <tianshuyu.formal@gmail.com>
```
  269bf46d
19 Mar, 2026 1 commit
- [SSM/Mamba] Follow-up: N-1 prefill for P/D disaggregation (#37310) · d49f2731
  zhanqiuhu authored Mar 19, 2026
  
  d49f2731
18 Mar, 2026 10 commits
- [Bugfix] Expand quantization method support in perf metrics (#37231) · 828f862a
  Thillai Chithambaram authored Mar 18, 2026
```
Signed-off-by: Thillai Chithambaram <thillaichithambaram.a@gmail.com>
```
  828f862a
- [Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype... · 577df69b
  Andy Lo authored Mar 18, 2026
```
[Bugfix] Fix KV scales inconsistency in fp8 MLA & FlashInfer kv_cache_dtype "auto" leading to gibberish (#37054)
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  577df69b
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [kv_offload+HMA][2/N]: Support multiple KV groups in GPULoadStoreSpec (#36642) · 5dd8df07
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  5dd8df07
- [kv_offload+HMA][6/N]: Split offloading_connector.py (#37405) · 525f2eeb
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  525f2eeb
- [NIXL][Bugfix] metrics & testing minor bug (#36051) · 98b09ddc
  Andy Lo authored Mar 18, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  98b09ddc
- [kv_offload+HMA][0/N]: Support block-level preemption handling (#34805) · fcf0687b
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  fcf0687b
- [XPU] skip unsupported ut and update test_nixl_connector (#37179) · 86b7e3c9
  liuzhenwei authored Mar 18, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  86b7e3c9
- [CI] Stabilize test_cpu_offloading by waiting for async offload before cache reset (#37335) · ce2ef42f
  Andreas Karatzas authored Mar 18, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ce2ef42f
- [Hardware][TPU] Add supports_async_scheduling() method to Executor interface... · a0dd1995
  gxd3 authored Mar 17, 2026
```
[Hardware][TPU] Add supports_async_scheduling() method to Executor interface so that it can be extended for Executor implementations. (#36924)
Signed-off-by: Guangxiang Du <gxd@google.com>
```
  a0dd1995
17 Mar, 2026 4 commits
- Make KV connector metadata build overridable via plugin (#37336) · de35c06c
  Yong Hoon Shin authored Mar 17, 2026
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  de35c06c
- [Bugfix] Fix NemotronH MTP + Chunked Prefill (#35447) · 8a680463
  Benjamin Chislett authored Mar 17, 2026
  
  8a680463
- [Refactor] Relocate responses API tests (#37241) · 3e3d320c
  Flora Feng authored Mar 17, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  3e3d320c
- [BugFix] Correct max memory usage for multiple KV-cache groups (#36030) · 45f526d6
  Harry Huang authored Mar 17, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  45f526d6
16 Mar, 2026 9 commits
- [CI] Stabilize multinode DP internal LB completion tests (#36356) · 4f9b14c2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  4f9b14c2
- [CI][BugFix][MORI][AMD] Add transfer_id to kv transfer params for test (#37213) · 2cc26c3a
  rasmith authored Mar 16, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2cc26c3a
- [Refactor] Consolidate GPT-OSS reasoning parser tests (#36915) · dfa8852d
  Flora Feng authored Mar 16, 2026
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
Signed-off-by: Flora Feng <4florafeng@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  dfa8852d
- [PD][Nixl] Add support for hybrid SSM-FA models (#36687) · f5c081d4
  Nicolò Lucchesi authored Mar 16, 2026
  
  f5c081d4
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- [Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013) · 04bf5a35
  Fynn Schmitt-Ulms authored Mar 16, 2026
  
  04bf5a35
- [Bugfix] Fix GDN attention crash with mixed decode/spec-decode batches (#34871) · 116ed130
  haosdent authored Mar 16, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
```
  116ed130
- [ROCm][CI] Retrying in case of batch variance effects and reducing flakiness (#36442) · a2956a0f
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  a2956a0f
- [ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845) · 911355e2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  911355e2
13 Mar, 2026 6 commits
- [Refactor] Consolidate SupportsEagle (#36063) · 8b346309
  Benjamin Chislett authored Mar 13, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  8b346309
- [CI] Split V1 e2e + engine (1 GPU) into separate jobs (#36945) · f1816fb1
  Kevin H. Luu authored Mar 13, 2026
```
Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
```
  f1816fb1
- [2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) · d5af196c
  Itay Alroy authored Mar 13, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  d5af196c
- [kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610) · cfaf4668
  Or Ozeri authored Mar 13, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cfaf4668
- [Frontend] Delegate preprocessing to `OpenAIServingRender` (#36483) · a2268617
  Sage authored Mar 13, 2026
```
Signed-off-by: Sage Ahrac <sagiahrak@gmail.com>
```
  a2268617
- [Frontend] Fix usage incorrectly returned with empty stream_options` (#36379) · bc2c0c86
  Csrayz authored Mar 13, 2026
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  bc2c0c86
12 Mar, 2026 5 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [CI] Fix mypy for vllm/reasoning (#35742) · 7f1f36bf
  Martin Hickey authored Mar 12, 2026
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7f1f36bf
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
- [Frontend] OpenAI Responses API supports Tool/Function calling with streaming (#29947) · 9fe404ed
  Chauncey authored Mar 12, 2026
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  9fe404ed
- [Perf] Optimize compute maxsim using batched version, 3.2% E2E throughput improvement (#36710) · c34ba6b9
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  c34ba6b9
11 Mar, 2026 3 commits
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- [NIXL][1/N] Refactor `kernel_block_size` detection (#35752) · 098d8447
  Nicolò Lucchesi authored Mar 11, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  098d8447