Commits · 5ea71ff46fe503df12f18ad41d40f5c2b18dcfcd · OpenDAS / vllm_cscc

05 Aug, 2025 3 commits
- [V1] reduce block size for tree attention correctness test to fix 'ou… (#22207) · 5ea71ff4
  Giancarlo Delfin authored Aug 04, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  5ea71ff4
- Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223) · 71758176
  Woosuk Kwon authored Aug 04, 2025
  
  71758176
- [Bugfix] V1 Fix the cursor leakage issue during request scheduling. (#21173) · 2dffac46
  PiteXChen authored Aug 05, 2025
```
Signed-off-by: CLFutureX <775523362@qq.com>
```
  2dffac46
04 Aug, 2025 4 commits
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) · 8ecb3e9e
  Tyler Michael Smith authored Aug 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8ecb3e9e
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- [PD] add test for chat completions endpoint (#21925) · 0d7db16a
  Abirdcfly authored Aug 04, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  0d7db16a
03 Aug, 2025 2 commits
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
02 Aug, 2025 3 commits
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
- Fix test_kv_sharing_fast_prefill flakiness (#22038) · 8564dc94
  Yong Hoon Shin authored Aug 01, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8564dc94
- [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) · 0edaf752
  Sage Moore authored Aug 01, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0edaf752
01 Aug, 2025 2 commits
- [Bugfix] fix when skip tokenizer init (#21922) · b879ecd6
  rongfu.leng authored Aug 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  b879ecd6
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
31 Jul, 2025 4 commits
- [Misc] Add unit tests for chunked local attention (#21692) · 71470bc4
  Yong Hoon Shin authored Jul 31, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  71470bc4
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
30 Jul, 2025 7 commits
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
29 Jul, 2025 2 commits

[KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
755fa8b6

[V0 deprecation] Guided decoding (#21347) · 37efc63b

Reza Barazesh authored Jul 29, 2025

Signed-off-by: Reza Barazesh <rezabarazesh@meta.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

37efc63b

28 Jul, 2025 4 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [v1][mamba] Added mamba_type into MambaSpec (#21715) · a6c05028
  Asaf Joseph Gardin authored Jul 28, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  a6c05028
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
- [Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f
  Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  86ae693f
26 Jul, 2025 1 commit

Support encoder-only models without KV-Cache (#21270) · 1cd6eaba

Maximilien de Bayser authored Jul 26, 2025


Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

1cd6eaba

25 Jul, 2025 5 commits
- [TPU][Test] Rollback PR-21550. (#21619) · 7cfea0df
  QiliangCui authored Jul 25, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  7cfea0df
- [Tests] Harden DP tests (#21508) · e38e96a3
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  e38e96a3
- [TPU][Bugfix] fix OOM issue in CI test (#21550) · 40d86ee4
  Chengji Yao authored Jul 24, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  40d86ee4
- [TPU][Test] Temporarily suspend this MoE model in test_basic.py. (#21560) · e0be2c4d
  QiliangCui authored Jul 24, 2025
```
Signed-off-by: Qiliang Cui <derrhein@gmail.com>
```
  e0be2c4d
- [DP] Support api-server-count > 0 in hybrid DP LB mode (#21510) · 9c8b2c2a
  Nick Hill authored Jul 25, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  9c8b2c2a
24 Jul, 2025 3 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[P/D] Move FakeNixlWrapper to test dir (#21328) · 1e9ea8e6
Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
1e9ea8e6
[Attention] Optimize FlashInfer MetadataBuilder Build call (#21137) · 61b8cea3
Lucas Wilkinson authored Jul 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
61b8cea3