Commits · ef2c4f778df5aa07a44e663330e2dfdc16927d2a · OpenDAS / vllm_cscc

"deploy/vscode:/vscode.git/clone" did not exist on "dd93d845c47e6822ab04cd1ea3aff8dfc76ba951"

18 Mar, 2026 6 commits
- [V0 Deprecation] Deprecate virtual engine (#37195) · 0d81a1fe
  Wentao Ye authored Mar 18, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  0d81a1fe
- [kv_offload+HMA][2/N]: Support multiple KV groups in GPULoadStoreSpec (#36642) · 5dd8df07
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  5dd8df07
- elastic_ep: Fix stateless group port races (#36330) · de1a86b7
  Itay Alroy authored Mar 18, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
```
  de1a86b7
- [kv_offload+HMA][6/N]: Split offloading_connector.py (#37405) · 525f2eeb
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  525f2eeb
- [NIXL][Bugfix] metrics & testing minor bug (#36051) · 98b09ddc
  Andy Lo authored Mar 18, 2026
```
Signed-off-by: Andy Lo <andy@mistral.ai>
```
  98b09ddc
- [kv_offload+HMA][0/N]: Support block-level preemption handling (#34805) · fcf0687b
  Or Ozeri authored Mar 18, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  fcf0687b
17 Mar, 2026 4 commits
- [Bug] Fix FlashInfer MNNVL socket collisions under concurrent vLLM jobs (#36674) · bdb903bb
  Wentao Ye authored Mar 17, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  bdb903bb
- [Chore] Replace all base64 usages with faster pybase64 package (#37290) · a836524d
  Isotr0py authored Mar 17, 2026
```
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  a836524d
- [Bugfix] Fix unclean shutdown crash with AllReduce Fusion workspace (#36955) · c25dbc2d
  Siew's Capital Jarvis authored Mar 17, 2026
```
Signed-off-by: Jarvis <brayden.stanley.0127@gmail.com>
```
  c25dbc2d
- [perf][connector] optimize build_connector_meta when host buffer transfer is not used (#37165) · 0fb142a4
  youkaichao authored Mar 17, 2026
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  0fb142a4
16 Mar, 2026 6 commits
- [Bugfix][MultiConnector] Fix MultiConnector for SupportsHMA sub-connectors (#36549) · 2dccb38f
  zhanqiuhu authored Mar 16, 2026
  
  2dccb38f
- [PD][Nixl] Add support for hybrid SSM-FA models (#36687) · f5c081d4
  Nicolò Lucchesi authored Mar 16, 2026
  
  f5c081d4
- [Bugfix] Disable cross-layer KV cache for MLA attention backends (#37090) · ca1954d5
  haosdent authored Mar 17, 2026
```
Signed-off-by: haosdent <haosdent@gmail.com>
Co-authored-by: Or Ozeri <oro@il.ibm.com>
```
  ca1954d5
- [Spec Decode] Update extract_hidden_states to use deferred kv_connector clear (#37013) · 04bf5a35
  Fynn Schmitt-Ulms authored Mar 16, 2026
  
  04bf5a35
- [Kernel] Add FlashInfer MoE A2A Kernel (#36022) · 2754231b
  leo-cf-tian authored Mar 16, 2026
```
Signed-off-by: wzhao18 <wzhao18.sz@gmail.com>
Signed-off-by: Leo Tian <lctian@nvidia.com>
Co-authored-by: wzhao18 <wzhao18.sz@gmail.com>
Co-authored-by: Stefano Castagnetta <scastagnetta@nvidia.com>
Co-authored-by: root <root@lyris0267.lyris.clusters.nvidia.com>
```
  2754231b
- [ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so... · 0024f39a
  rasmith authored Mar 15, 2026
```
[ROCm][P/D][MORI][BugFix] Add transfer_id for moriio_connector so moriio_connector to restore P/D functionality (#34907)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
```
  0024f39a
13 Mar, 2026 4 commits
- [Misc] Set default `kv_buffer_device` in a better way (#36862) · 5a3f1eb6
  Harry Mellor authored Mar 13, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  5a3f1eb6
- [2/N] Elastic EP Milestone 2: Integrating NIXL-EP (#35627) · d5af196c
  Itay Alroy authored Mar 13, 2026
```
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>
```
  d5af196c
- [kv_offload+HMA][1/N]: Support multiple KV groups in OffloadingSpec (#36610) · cfaf4668
  Or Ozeri authored Mar 13, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cfaf4668
- [BUG] Fix rank calculation in NCCLWeightTransferEngine (#36940) · 5e1a373d
  Aaron Hao authored Mar 12, 2026
```
Signed-off-by: hao-aaron <ahao@anyscale.com>
```
  5e1a373d
12 Mar, 2026 4 commits
- [Hardware] Replace torch.cuda.device_count/current_device/set_device API (#36145) · 53ec16a7
  Kunshang Ji authored Mar 12, 2026
```
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  53ec16a7
- [KV Connector] Support using FlexKV as KV Cache Offloading option. (#34328) · 8cb24d3a
  sfeiqiang authored Mar 12, 2026
```
Signed-off-by: phaedonsun <phaedonsun@tencent.com>
Co-authored-by: phaedonsun <phaedonsun@tencent.com>
```
  8cb24d3a
- replace `with torch.cuda.device` with `with torch.accelerator.device_index` (#36144) · 894843eb
  Yan Ma authored Mar 12, 2026
```
Signed-off-by: Yan Ma <yan.ma@intel.com>
```
  894843eb
- [LMCache] Fault Tolerance Mechanism (#36586) · 2ef69456
  Yuwei An authored Mar 11, 2026
```
Signed-off-by: Oasis-Git <ayw.sirius19@gmail.com>
```
  2ef69456
11 Mar, 2026 7 commits
- [LMCache] Pass TP size in lookup for MLA multi-reader locking (#36129) · 12001f2e
  maobaolong authored Mar 12, 2026
```
Signed-off-by: baoloongmao <baoloongmao@tencent.com>
Co-authored-by: Yihua Cheng <yihua98@uchicago.edu>
```
  12001f2e
- [BugFix][kv_offload] Fix offloading decodes with async scheduling (#33881) · 7ee5d509
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  7ee5d509
- [Refactor] Remove dead code in KV connector (#36424) · 35bdca54
  Wentao Ye authored Mar 11, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  35bdca54
- [KVConnector] Support worker -> scheduler metadata (#31964) · a1a3523a
  Or Ozeri authored Mar 11, 2026
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
```
  a1a3523a
- [XPU]Bug fix for some unexpected error when use AgRs backend on XPU device. (#36593) · c910eeb1
  YiSheng5 authored Mar 11, 2026
```
Signed-off-by: yisheng <yi.sheng@intel.com>
```
  c910eeb1
- [NIXL][1/N] Refactor `kernel_block_size` detection (#35752) · 098d8447
  Nicolò Lucchesi authored Mar 11, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  098d8447
- [Hardware][NIXL] set default kv buffer type for different platform (#36438) · f22d6e02
  liuzhenwei authored Mar 11, 2026
```
Signed-off-by: zhenwei-intel <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>
```
  f22d6e02
10 Mar, 2026 1 commit
- [CI] Bump `mypy` version to 1.19.1 (#36104) · f83b933b
  Harry Mellor authored Mar 10, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  f83b933b
09 Mar, 2026 2 commits
- [bugfix] fix nvlink for nixl/ucx (#36475) · f85b4eda
  youkaichao authored Mar 10, 2026
```
Signed-off-by: youkaichao <youkaichao@gmail.com>
```
  f85b4eda
- Reapply [Attention] Refactor `check_and_update_config` (#35122) · 77a73458
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  77a73458
07 Mar, 2026 2 commits
- [LMCache MP Patch]: Race Condition + Duplicated Block Ids (#35831) · 5d6aae45
  Samuel Shen authored Mar 07, 2026
  
  5d6aae45
- [Bugfix][LMCache][KVConnector] fix potential memory leak in LMCache multiprocess mode (#35931) · 63298ee1
  Roy Huang authored Mar 07, 2026
  
  63298ee1
06 Mar, 2026 1 commit
- [Core][KVConnector] Support HMA+NixlConnector (#35758) · 5b3ba94a
  Nicolò Lucchesi authored Mar 06, 2026
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  5b3ba94a
05 Mar, 2026 3 commits
- [Bugfix][CI] fix typos (#34934) · 6a895197
  Jiayi Yan authored Mar 06, 2026
```
Signed-off-by: 1195343015 <1195343015@qq.com>
Signed-off-by: Jiayi Yan <66017932+1195343015@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  6a895197
- [Hardware] Replace `torch.cuda.synchronize()` api with `torch.accelerator.synchronize` (#36085) · 66a22096
  Kunshang Ji authored Mar 05, 2026
```
Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
```
  66a22096
- Add platform method to enable custom collective ops registration (#34760) · 792cbd64
  nkm-meta authored Mar 04, 2026
```
Signed-off-by: Naina Kuruballi Mahesh <nainakm@meta.com>
```
  792cbd64