Commits · dd572c0ab3effa539b74f9a1288bb61ce83ada76 · OpenDAS / vllm_cscc

19 Jul, 2025 2 commits

[V0 Deprecation] Remove V0 Spec Decode workers (#21152) · dd572c0a
Woosuk Kwon authored Jul 18, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dd572c0a

[Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14

Lucia Fang authored Jul 19, 2025


Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>

9a9fda14

18 Jul, 2025 1 commit
- [Core] Avoid KVCacheBlock.__eq__ invocations in FreeKVCacheBlockQueue (#21005) · 0f199f19
  JialinOuyang-Meta authored Jul 18, 2025
```
Signed-off-by: Jialin Ouyang <jialino@meta.com>
```
  0f199f19
17 Jul, 2025 3 commits
- [Bugfix]: Fix final_res_batch list index out of range error (#21055) · fdc5b43d
  Chauncey authored Jul 17, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  fdc5b43d
- [V1] [KVConnector] Fix MultiprocExecutor worker output aggregation (#21048) · 4fcef49e
  David Ben-David authored Jul 17, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  4fcef49e
- [Attention] Refactor attention metadata builder interface (#20466) · 76b49444
  Lucas Wilkinson authored Jul 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  76b49444
16 Jul, 2025 3 commits
- [Meta] Llama4 EAGLE Support (#20591) · c11013db
  zhiweiz authored Jul 15, 2025
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>
```
  c11013db
- [CI] update typos config for CI pre-commit and fix some spells (#20919) · 1eb2b9c1
  Peter Pan authored Jul 16, 2025
```
Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>
```
  1eb2b9c1
- [Frontend] OpenAI Responses API supports input image (#20975) · 34cda778
  Chauncey authored Jul 16, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  34cda778
15 Jul, 2025 2 commits
- Implement Async Scheduling (#19970) · d4d30940
  Woosuk Kwon authored Jul 14, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  d4d30940
- Use w8a8 quantized matmul Pallas kernel (#19170) · d4170fad
  XiongfeiWei authored Jul 14, 2025
```
Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>
```
  d4170fad
14 Jul, 2025 3 commits
- [MISC] Move bind_kv_cache to worker module (#20900) · 1e9438e0
  wangxiyuan authored Jul 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  1e9438e0
- [Prefix Cache] Add reproducible prefix-cache block hashing using SHA-256 + CBOR (64bit) (#20511) · 66f6fbd3
  Maroon Ayoub authored Jul 14, 2025
```
Signed-off-by: Maroon Ayoub <maroon.ayoub@ibm.com>
```
  66f6fbd3
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
12 Jul, 2025 1 commit
- [Sched] Enhance the logic to remove stopped requests from queues (#20739) · f45a3328
  Woosuk Kwon authored Jul 12, 2025
  
  f45a3328
11 Jul, 2025 1 commit
- [Attention] MLA - Flashinfer Ragged Prefill (#20034) · 5b032352
  Alexander Matveev authored Jul 10, 2025
  
  5b032352
10 Jul, 2025 1 commit
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
09 Jul, 2025 3 commits
- [BugFix]: Properly set engine_id when using multi connector (#19487) · cd587c93
  Yiming authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: leiyiming <leiyiming@kingsoft.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  cd587c93
- [TPU][Bugfix] fix test_pallas (#20666) · eb58f595
  Chengji Yao authored Jul 09, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  eb58f595
- [XPU] Use spawn with XPU multiprocessing (#20649) · e760fcef
  Dmitry Rogozhkin authored Jul 09, 2025
```
Signed-off-by: Dmitry Rogozhkin <dmitry.v.rogozhkin@intel.com>
```
  e760fcef
08 Jul, 2025 3 commits
- [TPU][Bugfix] disable phi-3 test (#20632) · d8ee5a2c
  QiliangCui authored Jul 08, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  d8ee5a2c
- [PD][Nixl] Remote consumer READ timeout for clearing request blocks (#20139) · 71d1d75b
  Nicolò Lucchesi authored Jul 08, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  71d1d75b
- [Bugfix]: Fix messy code when using logprobs (#19209) · 93b9d9f4
  Chauncey authored Jul 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  93b9d9f4
07 Jul, 2025 1 commit
- Implement OpenAI Responses API [1/N] (#20504) · 462b2692
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  462b2692
05 Jul, 2025 1 commit
- [v1] Re-add fp32 support to v1 engine through FlexAttention (#19754) · 32c9be22
  Isotr0py authored Jul 05, 2025
```
Signed-off-by: Isotr0py <2037008807@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
```
  32c9be22
04 Jul, 2025 3 commits

Enable V1 for Hybrid SSM/Attention Models (#20016) · 2f35a022

Thomas Parnell authored Jul 04, 2025


Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
Co-authored-by: Tyler Michael Smith <tysmith@redhat.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

2f35a022

[Misc] Add SPDX-FileCopyrightText (#20428) · 1caca5a5
Jee Jee Li authored Jul 04, 2025
```
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
```
1caca5a5
[Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
4a98edff

03 Jul, 2025 1 commit
- [Tests] Update online DP tests to verify that requests are balanced (#20157) · 67d25eca
  Nick Hill authored Jul 03, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  67d25eca
02 Jul, 2025 4 commits
- [DP] Support external DP Load Balancer mode (#19790) · 657f2f30
  Nick Hill authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  657f2f30
- [V1] LogitsProcessor programming model (#16728) · 48fb076c
  afeldman-nm authored Jul 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Andrew Feldman <afeldman@neuralmagic.com>
Signed-off-by: Andrew Feldman <afeldman@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  48fb076c
- [TPU] kv cache update kernel supports dynamic grid (#20235) · 7da296be
  Chengji Yao authored Jul 01, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  7da296be
- [UT][intel GPU] use current_platform instead of device hardcode in v1 tests (#20169) · a0389e05
  Liangliang Ma authored Jul 02, 2025
```
Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>
```
  a0389e05
01 Jul, 2025 1 commit
- [Optimization] Cache sampled token ids in model runner (#20291) · 7f280d69
  Woosuk Kwon authored Jul 01, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  7f280d69
30 Jun, 2025 1 commit
- [Optimization] Use Shared `CachedRequestData` Instance Across All Requests (#20232) · 2863befc
  Woosuk Kwon authored Jun 30, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  2863befc
26 Jun, 2025 3 commits
- [TPU] add kv cache update kernel (#19928) · 04e1642e
  Chengji Yao authored Jun 26, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  04e1642e
- [Bugfix] Allow `CUDA_VISIBLE_DEVICES=''` in `Platform.device_id_to_physical_device_id` (#18979) · 65397e40
  Seiji Eicher authored Jun 26, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  65397e40
- [PD] Skip `tp_size` exchange with rank0 (#19413) · 25826835
  Nicolò Lucchesi authored Jun 26, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  25826835
25 Jun, 2025 2 commits
- [TPU] Add TPU specific var VLLM_TPU_MOST_MODEL_LEN (#19919) · 2d7620c3
  Chenyaaang authored Jun 25, 2025
```
Signed-off-by: Chenyaaang <chenyangli@google.com>
```
  2d7620c3
- [PD] let toy proxy handle /chat/completions (#19730) · 4734704b
  lkchen authored Jun 25, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  4734704b