Commits · 6287e7fa208199da2dc2869646291a902c0d5caa · OpenDAS / vllm_cscc · GitLab

27 Mar, 2026 2 commits
- [P/D] Mooncake: Add unit tests and minor fixes for mooncake connector (#36946) · 6287e7fa
  dtc authored Mar 27, 2026
```
Signed-off-by: Tianchen Ding <dtcccc@linux.alibaba.com>
```
  6287e7fa
- [kv_offload+HMA][7/N]: Support register_kv_caches for hybrid models (#37853) · 7cc302dd
  Or Ozeri authored Mar 27, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  7cc302dd
25 Mar, 2026 1 commit
- [Mypy] Better fixes for the `mypy` issues in `vllm/config` (#37902) · d215d1ef
  Harry Mellor authored Mar 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d215d1ef
23 Mar, 2026 1 commit
- [CI][PD] Add Hybrid SSM integration tests to CI (#37657) · 1cbbcfe8
  Nicolò Lucchesi authored Mar 23, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  1cbbcfe8
19 Mar, 2026 1 commit
- [SSM/Mamba] Follow-up: N-1 prefill for P/D disaggregation (#37310) · d49f2731
  zhanqiuhu authored Mar 19, 2026
  
  d49f2731
18 Mar, 2026 5 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [kv_offload+HMA][6/N]: Split offloading_connector.py (#37405) · 525f2eeb
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  525f2eeb
- [NIXL][Bugfix] metrics & testing minor bug (#36051) · 98b09ddc
  Andy Lo authored Mar 18, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  98b09ddc
- [kv_offload+HMA][0/N]: Support block-level preemption handling (#34805) · fcf0687b
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  fcf0687b
- [XPU] skip unsupported ut and update test_nixl_connector (#37179) · 86b7e3c9
  liuzhenwei authored Mar 18, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  86b7e3c9
17 Mar, 2026 1 commit
- Make KV connector metadata build overridable via plugin (#37336) · de35c06c
  Yong Hoon Shin authored Mar 17, 2026
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  de35c06c
16 Mar, 2026 4 commits
- [CI][BugFix][MORI][AMD] Add transfer_id to kv transfer params for test (#37213) · 2cc26c3a
  rasmith authored Mar 16, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  2cc26c3a
- [PD][Nixl] Add support for hybrid SSM-FA models (#36687) · f5c081d4
  Nicolò Lucchesi authored Mar 16, 2026
  
  f5c081d4
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- [ROCm] Fix KV copy methods and auto-select attention backend for ROCm (#36845) · 911355e2
  Andreas Karatzas authored Mar 16, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  911355e2
13 Mar, 2026 2 commits
- [Refactor] Consolidate SupportsEagle (#36063) · 8b346309
  Benjamin Chislett authored Mar 13, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  8b346309
- [kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610) · cfaf4668
  Or Ozeri authored Mar 13, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cfaf4668
12 Mar, 2026 2 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
11 Mar, 2026 4 commits
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- [NIXL][1/N] Refactor `kernel_block_size` detection (#35752) · 098d8447
  Nicolò Lucchesi authored Mar 11, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  098d8447
- [Perf] Optimize scheduler overhead for PD disaggregation, around 5% E2E perf improvement (#35781) · a8ff2cca
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
Signed-off-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  a8ff2cca
09 Mar, 2026 1 commit
- [XPU] Add test script of PD disaggregation (#36434) · 1bc9c77f
  liuzhenwei authored Mar 09, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
```
  1bc9c77f
07 Mar, 2026 2 commits
- [CI] Enable Crosslayer KV layout tests for ROCm platforms (#35416) · eebd1465
  qli88 authored Mar 07, 2026
  
  eebd1465
- [V0 Deprecation] Remove unused swap_space parameter (#36216) · 00b814ba
  lif authored Mar 07, 2026
```
Signed-off-by: majiayu000 <1835304752@qq.com>
Co-authored-by: mcelrath
```
  00b814ba
06 Mar, 2026 2 commits
- [Core][KVConnector] Support HMA+NixlConnector (#35758) · 5b3ba94a
  Nicolò Lucchesi authored Mar 06, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5b3ba94a
- [Spec Decode][KV Connector] Fix KV transfer in PD + speculative decoding (#35158) · 90f3c01f
  zhanqiuhu authored Mar 06, 2026
```
Signed-off-by: Claude <noreply@anthropic.com>
Signed-off-by: Zhanqiu Hu <zh338@cornell.edu>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  90f3c01f
05 Mar, 2026 2 commits

[Bugfix][CI] fix typos (#34934) · 6a895197

Jiayi Yan authored Mar 06, 2026

Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

6a895197

[KVConnector] Scheduler: Fix num_computed_tokens after async KV load (#34616) · 612e7729
Or Ozeri authored Mar 05, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
612e7729

02 Mar, 2026 1 commit
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
01 Mar, 2026 1 commit
- [AMD][CI] Support Triton attention with ExampleConnector (#34931) · 87d319c5
  Ryan Rock authored Mar 01, 2026
```
Signed-off-by: Ryan Rock <ryan.rock@amd.com>
```
  87d319c5
25 Feb, 2026 1 commit
- Remove requirement to use `--hf-overrides` for `DeepseekVLV2ForCausalLM` (#35203) · f7967577
  Harry Mellor authored Feb 25, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f7967577
24 Feb, 2026 1 commit
- [ROCm][CI] Added MI325 mirrors (#34923) · 067c5d9a
  Andreas Karatzas authored Feb 24, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  067c5d9a
21 Feb, 2026 1 commit
- [PD] Change kv_load_failure_policy Default from "recompute" to "fail" (#34896) · ab6f3487
  Nicolò Lucchesi authored Feb 21, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  ab6f3487
20 Feb, 2026 1 commit
- [CI][AMD][BugFix][P/D] Add default_vllm_config to test_moriio_connector.py so tests pass (#33739) · 0c1dc427
  rasmith authored Feb 19, 2026
```
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  0c1dc427
17 Feb, 2026 1 commit
- [CI][BugFix] ShellCheck cleanup to remove baseline and preserve runtime behavior (#34514) · c61a98f5
  junuxyz authored Feb 17, 2026
```
Signed-off-by: junuxyz <216036880+junuxyz@users.noreply.github.com>
```
  c61a98f5
13 Feb, 2026 1 commit
- [Refactor] Simplify BOS/EOS token handling (#34435) · ea5ff3a1
  Cyrus Leung authored Feb 13, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  ea5ff3a1
06 Feb, 2026 1 commit
- [KV Connector] Add missing method overrides to MultiConnector (#33292) · aca59674
  Seiji Eicher authored Feb 06, 2026
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  aca59674
05 Feb, 2026 1 commit

Enable Cross layers KV cache layout at NIXL Connector V2 (#33339) · 8322d4e4

liranschour authored Feb 05, 2026


Signed-off-by: Liran Schour <lirans@il.ibm.com>
Signed-off-by: liranschour <liranschour@users.noreply.github.com>
Co-authored-by: Or Ozeri <or@ozery.com>
Co-authored-by: Nicolò Lucchesi <nicolo.lucchesi@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>

8322d4e4