Commits · 54de71d0dfbb6340fdbc620f4ebeb4236d165a37 · OpenDAS / vllm_cscc · GitLab

04 Aug, 2025 4 commits
- [Sampler] Support returning all logprobs or logits (#21792) · 54de71d0
  22quinn authored Aug 04, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  54de71d0
- [refactor] improve ConstantList exception specificity (#22156) · 49bcd893
  ZiTian.Zhao authored Aug 04, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  49bcd893
- Add tree attention backend for v1 (part 1) (#20401) · aa7012eb
  Giancarlo Delfin authored Aug 03, 2025
```
Signed-off-by: Giancarlo Delfin <gdelfin@meta.com>
```
  aa7012eb
- [fix] fix correct assertion syntax error in attention utils. (#22154) · e27d25a0
  ZiTian.Zhao authored Aug 04, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  e27d25a0
03 Aug, 2025 2 commits
- [V1] [P/D] Refactor KV Connector Path (#21980) · aefeea0f
  David Ben-David authored Aug 03, 2025
```
Signed-off-by: David Ben-David <davidb@pliops.com>
Co-authored-by: David Ben-David <davidb@pliops.com>
```
  aefeea0f
- [executor] feat: add supports_pp attr to executors (#21786) · 24d1dffb
  H authored Aug 03, 2025
```
Signed-off-by: Haibin Lin <haibin.lin@bytedance.com>
```
  24d1dffb
02 Aug, 2025 4 commits
- [V1] [Hybrid] Validate compatibility of attention backend batch reordering at init time (#21557) · 4abfd879
  Thomas Parnell authored Aug 02, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  4abfd879
- [Attention][DBO] Add support for "splitting" the CommonAttentionMetadata (#21153) · 0edaf752
  Sage Moore authored Aug 01, 2025
```
Signed-off-by: Sage Moore <sage@neuralmagic.com>
```
  0edaf752
- [BugFix] Improve internal DP load balancing (#21617) · 8d524ce7
  Nick Hill authored Aug 02, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  8d524ce7
- [V1][CUDA] Full cudagraph support for FlashInfer (#21367) · 23322431
  fhl2000 authored Aug 02, 2025
  
  23322431
01 Aug, 2025 7 commits
- [BugFix] Harden distributed DP startup (#21538) · 881e1af4
  Nick Hill authored Aug 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  881e1af4
- [Bugfix] fix when skip tokenizer init (#21922) · b879ecd6
  rongfu.leng authored Aug 02, 2025
```
Signed-off-by: rongfu.leng <rongfu.leng@daocloud.io>
```
  b879ecd6
- Deprecate `--disable-log-requests` and replace with `--enable-log-requests` (#21739) · 2d7b09b9
  Harry Mellor authored Aug 01, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  2d7b09b9
- [Bugfix] Check NVIDIA artifactory is accessible before using flashinfer cubin kernels (#21893) · f81c1bb0
  Michael Goin authored Aug 01, 2025
  
  f81c1bb0
- [Bugfix] Add log prefix in non-dp mode engine core (#21889) · e6680f9e
  wuhang authored Aug 01, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  e6680f9e
- [Core] Avoid repeated len(block_token_ids) check in hash_request_tokens (#21781) · e0f63e4a
  Zebing Lin authored Aug 01, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  e0f63e4a
- [BugFix] fix: aot passes kvcache dtype information (#19750) · e1a7fe4a
  Mickaël Seznec authored Aug 01, 2025
```
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
```
  e1a7fe4a
31 Jul, 2025 3 commits
- [Meta] Official Eagle mm support, first enablement on llama4 (#20788) · 9e0726e5
  zhiweiz authored Jul 31, 2025
```
Signed-off-by: morgendave <morgendave@gmail.com>
Co-authored-by: Roger Wang <hey@rogerw.me>
```
  9e0726e5
- [BugFix] Fix case where `collective_rpc` returns `None` (#22006) · 5daffe7c
  Nick Hill authored Jul 31, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  5daffe7c
- [UX] Rename CUTLASS_MLA_VLLM_V1 to CUTLASS_MLA (#21966) · 61445453
  Michael Goin authored Jul 30, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  61445453
30 Jul, 2025 8 commits
- [Core] Move EngineCoreRequest to Request conversion out of EngineCore (#21627) · ca9e2be3
  Zebing Lin authored Jul 30, 2025
```
Signed-off-by: linzebing <linzebing1995@gmail.com>
```
  ca9e2be3
- [Misc] Support more collective_rpc return types (#21845) · 56bd537d
  Nick Hill authored Jul 30, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  56bd537d
- [Bugfix] Fix TypeError in scheduler when comparing mixed request_id types (#21816) · 5c765aec
  633WHU authored Jul 30, 2025
```
Signed-off-by: chiliu <chiliu@paypal.com>
Co-authored-by: chiliu <chiliu@paypal.com>
```
  5c765aec
- Override attention metadata for fast prefill in some KV sharing setups (#21590) · ad510309
  Yong Hoon Shin authored Jul 30, 2025
```
Signed-off-by: Yong Hoon Shin <yhshin@meta.com>
```
  ad510309
- [Misc] Improve code readability of KVCacheManager (#21673) · 8f4a1c9a
  Ruixiang Tan authored Jul 30, 2025
```
Signed-off-by: tanruixiang <tanruixiang0104@gmail.com>
Signed-off-by: Ruixiang Tan <819464715@qq.com>
Signed-off-by: GitHub <noreply@github.com>
```
  8f4a1c9a
- [Bugfix] Fix comment typo of get_num_common_prefix_blocks() (#21827) · b7b23da4
  MingzhenHan authored Jul 30, 2025
```
Signed-off-by: MingzhenHan <hanmingzhen2002@outlook.com>
```
  b7b23da4
- Expose PyTorch profiler configuration to environment variables (#21803) · b917da44
  Csrayz authored Jul 30, 2025
```
Signed-off-by: Csrayz <33659823+Csrayz@users.noreply.github.com>
```
  b917da44
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
29 Jul, 2025 4 commits
- [Bugfix] Fix workspace buffer None issue for Flashinfer TRTLLM Backend (#21525) · 58b11b24
  elvischenv authored Jul 29, 2025
```
Signed-off-by: elvischenv <219235043+elvischenv@users.noreply.github.com>
```
  58b11b24
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
- [KVCache] Make KVCacheSpec hashable (#21791) · 755fa8b6
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  755fa8b6
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
28 Jul, 2025 7 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [Logs] Change flashinfer sampler logs to once (#21759) · 34a20c49
  Michael Goin authored Jul 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  34a20c49
- [Bugfix]check health for engine core process exiting unexpectedly (#21728) · bccc43c0
  wuhang authored Jul 28, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  bccc43c0
- [v1][mamba] Added mamba_type into MambaSpec (#21715) · a6c05028
  Asaf Joseph Gardin authored Jul 28, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  a6c05028
- [BugFix] Fix ChunkedLocalAttention when the hybrid kv-cache is disabled (#21707) · 139a7f07
  Lucas Wilkinson authored Jul 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  139a7f07
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
- [Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f
  Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  86ae693f
27 Jul, 2025 1 commit
- Refactor: Remove numpy dependency from LoggingStatLogger (#20529) · a8936e51
  ZiTian.Zhao authored Jul 27, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  a8936e51