Commits · d6953beb91da4e9c99be4c0a1304a2d24189535c · OpenDAS / vllm_cscc

05 Oct, 2025 1 commit
- Convert formatting to use `ruff` instead of `yapf` + `isort` (#26247) · d6953beb
  Harry Mellor authored Oct 05, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  d6953beb
04 Oct, 2025 1 commit
- [Bugfix] Fix `_reqs_to_process` leak on abort (#26012) · 2a6dc67e
  Nicolò Lucchesi authored Oct 04, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2a6dc67e
03 Oct, 2025 2 commits
- [NIXL][Misc] Expose metrics from NIXL for logging to CLI (#25388) · 48f30902
  Nicolò Lucchesi authored Oct 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  48f30902
- [Attention] Move Backend enum into registry (#25893) · 2aaa4238
  Matthew Bonanni authored Oct 02, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2aaa4238
30 Sep, 2025 3 commits
- [V1] [P/D] Add Support for KV Load Failure Recovery (#19330) · 9a9f48df
  David Ben-David authored Oct 01, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  9a9f48df
- OffloadingConnector: Fix GPU block tracking bug (#25856) · cfd302db
  Or Ozeri authored Sep 30, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cfd302db
- [NIXL] Add support for MLA caches with different latent dim (#25902) · 80608ba5
  Nicolò Lucchesi authored Sep 30, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
```
  80608ba5
29 Sep, 2025 2 commits

[Nixl][P/D] Add cuda2cpu support (HD->DH transfer) (#24690) · d0d138bc
Chenxi Yang authored Sep 29, 2025
```
Signed-off-by: Chenxi Yang <cxyang@fb.com>
Co-authored-by: Chenxi Yang <cxyang@fb.com>
```
d0d138bc

Robert Shaw authored Sep 29, 2025


Signed-off-by: Sage Moore <sage@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Signed-off-by: Chenheli Hua <huachenheli@outlook.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: NickLucche <nlucches@redhat.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: rentianyue-jk <rentianyue-jk@360shuke.com>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Chenheli Hua <huachenheli@outlook.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Nicolò Lucchesi <nlucches@redhat.com>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

9b44a7d9

27 Sep, 2025 1 commit
- [Bugfix][NIXL] Fix Async Scheduler timeout issue (#25808) · da63274d
  Nicolò Lucchesi authored Sep 27, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  da63274d
25 Sep, 2025 1 commit
- [V0 deprecation] Remove _VLLM_V1 suffixes from attention backend names (#25489) · 3468f17e
  Matthew Bonanni authored Sep 25, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
```
  3468f17e
23 Sep, 2025 3 commits
- [V0 Deprecation] Remove placeholder attn (#25510) · 969b4da3
  Thomas Parnell authored Sep 24, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  969b4da3
- [P/D] Support NIXL connector to disconnect during a clean shutdown (#24423) · f05a4f0e
  Chauncey authored Sep 23, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
```
  f05a4f0e
- [NIXL][OOT platform] support nixl_connector with oot platform and other nixl_backend (#25121) · 5774b0a1
  Chendi.Xue authored Sep 22, 2025
```
Signed-off-by: Chendi Xue <Chendi.Xue@intel.com>
```
  5774b0a1
22 Sep, 2025 1 commit

[Bugfix] Fix several issues with p2p xPyD in GET type (#23993) · c10101a3

Csrayz authored Sep 22, 2025


Signed-off-by: Csrayz <jover@cmbchina.com>
Signed-off-by: ivyilike <pww123@cmbchina.com>
Co-authored-by: ivyilike <pww123@cmbchina.com>

c10101a3

21 Sep, 2025 1 commit
- Remove V0 attention backends (#25351) · bc6e542d
  Woosuk Kwon authored Sep 21, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  bc6e542d
20 Sep, 2025 1 commit

[BugFix] Ensure appropriate guards in destructors (#25284) · a25ade5d

Nick Hill authored Sep 19, 2025


Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

a25ade5d

19 Sep, 2025 2 commits
- [KV offload][4/N] Offloading KV connector (#22595) · c59a0eca
  Or Ozeri authored Sep 19, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  c59a0eca
- [P/D][Nixl] Introduce `KVTransferMetrics` and aggregation strategy (#22188) · a3d087ad
  Nicolò Lucchesi authored Sep 19, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  a3d087ad
15 Sep, 2025 2 commits
- [XPU] Set consistent default KV cache layout (#24745) · 2e41f5ab
  Nicolò Lucchesi authored Sep 15, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  2e41f5ab
- [P/D]`kv_output_aggregator` support P TP > D TP (#23917) · 8de261b0
  Chao Lei authored Sep 15, 2025
```
Signed-off-by: LCAIZJ <leichao139636@163.com>
Co-authored-by: leichao.lc <leichao.lc@antgroup.com>
```
  8de261b0
13 Sep, 2025 2 commits
- Remove redundant assignment in xfer_buffers, This is a little fix (#24732) · 15b8fef4
  TaoYu Chen authored Sep 13, 2025
```
Signed-off-by: ChenTaoyu-SJTU <ctynb@qq.com>
```
  15b8fef4
- [Docs] Fix warnings in mkdocs build (continued) (#24791) · 9a8966bc
  Hyogeun Oh (오효근) authored Sep 13, 2025
```
Signed-off-by: Zerohertz <ohg3417@gmail.com>
```
  9a8966bc
12 Sep, 2025 1 commit
- [Multimodal] Remove legacy multimodal fields in favor of MultiModalFeatureSpec (#24548) · 0377802c
  Flora Feng authored Sep 12, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  0377802c
10 Sep, 2025 2 commits
- [P/D] MultiConnector supports shutdown (#24425) · 309d7aa4
  Chauncey authored Sep 10, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  309d7aa4
- [KV Connector] More async support for `get_num_new_matched_tokens` (#23620) · b4a01aaf
  Yihua Cheng authored Sep 09, 2025
```
Signed-off-by: ApostaC <yihua98@uchicago.edu>
```
  b4a01aaf
09 Sep, 2025 1 commit
- Move `KVTransferConfig` from `config/__init__.py` to `config/kv_transfer.py` (#24434) · 3e0d4a34
  Harry Mellor authored Sep 09, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  3e0d4a34
08 Sep, 2025 2 commits
- [Doc]: fix typos in Python comments (#24417) · f4962a6d
  Didier Durand authored Sep 08, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  f4962a6d
- [P/D] Add a shutdown method to the Connector API (#22699) · 61aa4b29
  Chauncey authored Sep 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  61aa4b29
05 Sep, 2025 1 commit

[XPU][P/D] Add XPU support in NixlConnector (#22436) · e599e2c6

liuzhenwei authored Sep 05, 2025


Signed-off-by: zhenwei <zhenwei.liu@intel.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

e599e2c6

03 Sep, 2025 3 commits
- [Feature][P/D]: Optimize NIXL Connector xfer Launch (#23887) · 6adaed42
  WeiQing Chen authored Sep 04, 2025
```
Signed-off-by: ycyaw66 <497410282@qq.com>
Co-authored-by: ycyaw66 <497410282@qq.com>
```
  6adaed42
- [Nixl] Heterogeneous TP support FlashInfer (#20189) · f0c503f6
  Nicolò Lucchesi authored Sep 03, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  f0c503f6
- fix some typos (#24071) · 1bd007f2
  co63oc authored Sep 03, 2025
```
Signed-off-by: co63oc <co63oc@users.noreply.github.com>
```
  1bd007f2
01 Sep, 2025 1 commit
- v1: Support KV events from connectors (#19737) · 14b4326b
  Or Ozeri authored Sep 01, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  14b4326b
26 Aug, 2025 2 commits
- [V1][P/D]P2pNcclConnector supports flashinfer (#23536) · c3b0fd1e
  Zhonghua Deng authored Aug 27, 2025
```
Signed-off-by: Abatom <abzhonghua@gmail.com>
Co-authored-by: Simon Mo <simon.mo@hey.com>
```
  c3b0fd1e
- [Doc]: fix various spelling issues in multiple files (#23636) · 7c04779a
  Didier Durand authored Aug 26, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  7c04779a
25 Aug, 2025 1 commit

[Bugfix][V1][P/D]Fix the issue where repeated requests for the same input... · 9188ae7c

Zhonghua Deng authored Aug 26, 2025


[Bugfix][V1][P/D]Fix the issue where repeated requests for the same input produce abnormal outputs for P2pNcclConnector (#23403)
Signed-off-by: Abatom <abzhonghua@gmail.com>

9188ae7c

22 Aug, 2025 1 commit
- [P/D][Nixl] Make kv cache register compatible with hybrid memory allocator (#23079) · 53415653
  Flora Feng authored Aug 21, 2025
```
Signed-off-by: sfeng33 <4florafeng@gmail.com>
```
  53415653
15 Aug, 2025 1 commit
- [BugFix][KVConn] Fix use of `get_required_kvcache_layout` (#22734) · 0933f9d5
  Nick Hill authored Aug 14, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  0933f9d5
12 Aug, 2025 1 commit
- [CI][Nixl] Check kv cache layout during handshake (#22745) · 422f22e0
  Nicolò Lucchesi authored Aug 12, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  422f22e0