Commits · 65abe111a3035d3bf70dce217ba4e1889aa20dc3 · OpenDAS / vllm_cscc

11 Aug, 2025 4 commits
- [CI] Skip Tree Attn Test in `test_max_len.py` to unblock CI (#22664) · 65abe111
  TJian authored Aug 11, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  65abe111
- [BugFix] [Spec Decode] Remove LlamaForCausalLMEagle3 to fix CI (#22611) · 807d21b8
  22quinn authored Aug 11, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  807d21b8
- fix: NIXL connector transfers partial block to pass full multi-modal context (#21074) · 16fb668b
  GuanLuo authored Aug 11, 2025
```
Signed-off-by: GuanLuo <gluo@nvidia.com>
```
  16fb668b
- [BugFix] Fix KVConnectorOutput TPU breakage (#22598) · 5898b135
  Nick Hill authored Aug 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5898b135
10 Aug, 2025 2 commits

[TPU] kv cache update kernel doesn't need to be padded slices to multiple of... · 2a84fb42

Chengji Yao authored Aug 09, 2025


[TPU] kv cache update kernel doesn't need to be padded slices to multiple of num_slices_per_block (#22394)
Signed-off-by: Chengji Yao <chengjiyao@gmail.com>
Co-authored-by: Chengji Yao <chengjiyao@gmail.com>

2a84fb42

[Config] add "qwen" as a native eagle3 target supported model (#22333) · 3d7363e6
Le Chen authored Aug 10, 2025
```
Signed-off-by: lechen <lecself@163.com>
Signed-off-by: LeChen <lecself@163.com>
```
3d7363e6

09 Aug, 2025 1 commit
- [TPU] Add support for online w8a8 quantization (#22425) · 9a0c5ded
  Kyuyeun Kim authored Aug 08, 2025
```
Signed-off-by: Kyuyeun Kim <kyuyeunk@google.com>
```
  9a0c5ded
08 Aug, 2025 2 commits
- [Bugfix] Fix RuntimeError: Index put requires the source and destination dtypes match (#22065) · 17eaaef5
  Chauncey authored Aug 08, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  17eaaef5
- [ROCm] [V1] [SpecDec] Enable Speculative Decoding on ROCm V1 Engine (#21496) · 1ee5ead5
  TJian authored Aug 07, 2025
```
Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
```
  1ee5ead5
07 Aug, 2025 5 commits
- Remove `from_dict` from `SpeculativeConfig` (#22451) · 7e3a8dc9
  Harry Mellor authored Aug 07, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  7e3a8dc9
- [gpt-oss] Generate ResponseOutputItem from Harmony Message (#22410) · 4815b00f
  Chen Zhang authored Aug 07, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  4815b00f
- Use float32 for test_completion.py (#22385) · a00d8b23
  Michael Goin authored Aug 06, 2025
```
Signed-off-by: Michael Goin <mgoin64@gmail.com>
```
  a00d8b23
- [Attention] Support multiple attention metadata builders per kv_cache_spec +... · 1dc8a70b
  Lucas Wilkinson authored Aug 06, 2025
```
[Attention] Support multiple attention metadata builders per kv_cache_spec  + proper local attention no hybrid kv cache fix (#21588)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1dc8a70b
- [v1] - Mamba1 Attention Metadata (#21249) · 46a13949
  Asaf Joseph Gardin authored Aug 07, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  46a13949
05 Aug, 2025 5 commits
- [V1] port xformers backend to v1 (#21342) · 469b3ffa
  Giancarlo Delfin authored Aug 05, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  469b3ffa
- [V0 Deprecation][TPU] Remove V1 flag check from tests (#22248) · 0c275ad5
  Nicolò Lucchesi authored Aug 05, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
  0c275ad5
- [V1] reduce block size for tree attention correctness test to fix 'ou… (#22207) · 5ea71ff4
  Giancarlo Delfin authored Aug 04, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  5ea71ff4
- Revert "[Bugfix] V1 Fix the cursor leakage issue during request scheduling." (#22223) · 71758176
  Woosuk Kwon authored Aug 04, 2025
  
  71758176
- [Bugfix] V1 Fix the cursor leakage issue during request scheduling. (#21173) · 2dffac46
  PiteXChen authored Aug 05, 2025
```
Signed-off-by: CLFutureX <775523362@qq.com>
```
  2dffac46
04 Aug, 2025 4 commits
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [CI Bugfix] Fix wNa16 kernel not found for test_shared_storage_connector_hashes (#22163) · 8ecb3e9e
  Tyler Michael Smith authored Aug 04, 2025
```
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
```
  8ecb3e9e
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- [PD] add test for chat completions endpoint (#21925) · 0d7db16a
  Abirdcfly authored Aug 04, 2025
```
Signed-off-by: Abirdcfly <fp544037857@gmail.com>
```
  0d7db16a
03 Aug, 2025 2 commits
- [Responses API] Disable response store by default (#22137) · 6d98843b
  Woosuk Kwon authored Aug 03, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  6d98843b
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
02 Aug, 2025 3 commits
- docs: remove deprecated disable-log-requests flag (#22113) · 067c34a1
  Roger Wang authored Aug 02, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
```
  067c34a1
- Fix test_kv_sharing_fast_prefill flakiness (#22038) · 8564dc94
  Yong Hoon Shin authored Aug 01, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  8564dc94
- [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) · 0edaf752
  Sage Moore authored Aug 01, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0edaf752
01 Aug, 2025 2 commits
- [Bugfix] fix when skip tokenizer init (#21922) · b879ecd6
  rongfu.leng authored Aug 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  b879ecd6
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
31 Jul, 2025 4 commits
- [Misc] Add unit tests for chunked local attention (#21692) · 71470bc4
  Yong Hoon Shin authored Jul 31, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  71470bc4
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [CI Bugfix] Fix CI OOM for `test_shared_storage_connector_hashes` (#21973) · 055bd397
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  055bd397
30 Jul, 2025 6 commits
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [Bugfix] SharedStorage Connector for V1 PD multimodal (#21611) · 4904e53c
  Chenguang Zheng authored Jul 31, 2025
```
Signed-off-by: fake0fan <645327136@qq.com>
Signed-off-by: herotai214 <herotai214@gmail.com>
Co-authored-by: herotai214 <herotai214@gmail.com>
```
  4904e53c
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a