Commits · 2470419119aa5bc2734b4b8972bbfa348ccdc8b1 · OpenDAS / vllm_cscc

29 Jul, 2025 1 commit
- [Misc] Rework process titles (#21780) · 7234fe26
  Nick Hill authored Jul 29, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  7234fe26
28 Jul, 2025 7 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [Logs] Change flashinfer sampler logs to once (#21759) · 34a20c49
  Michael Goin authored Jul 28, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  34a20c49
- [Bugfix]check health for engine core process exiting unexpectedly (#21728) · bccc43c0
  wuhang authored Jul 28, 2025
```
Signed-off-by: wuhang <wuhang6@huawei.com>
```
  bccc43c0
- [v1][mamba] Added mamba_type into MambaSpec (#21715) · a6c05028
  Asaf Joseph Gardin authored Jul 28, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  a6c05028
- [BugFix] Fix ChunkedLocalAttention when the hybrid kv-cache is disabled (#21707) · 139a7f07
  Lucas Wilkinson authored Jul 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  139a7f07
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
- [Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f
  Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  86ae693f
27 Jul, 2025 1 commit
- Refactor: Remove numpy dependency from LoggingStatLogger (#20529) · a8936e51
  ZiTian.Zhao authored Jul 27, 2025
```
Signed-off-by: zitian.zhao <zitian.zhao@tencentmusic.com>
```
  a8936e51
26 Jul, 2025 3 commits
- [Misc] Improve memory profiling debug message (#21429) · a40a8506
  Ye (Charlotte) Qi authored Jul 26, 2025
```
Signed-off-by: Ye (Charlotte) Qi <yeq@meta.com>
```
  a40a8506
- Support encoder-only models without KV-Cache (#21270) · 1cd6eaba
  Maximilien de Bayser authored Jul 26, 2025
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  1cd6eaba
- [Bugfix] Fix sync_and_slice_intermediate_tensors (#21537) · cea96a01
  Rui Qiao authored Jul 25, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  cea96a01
25 Jul, 2025 3 commits
- [ROCm][AITER] Enable fp8 kv cache on rocm aiter backend. (#20295) · b3caeb82
  who who who authored Jul 25, 2025
```
Signed-off-by: fsx950223 <fsx950223@outlook.com>
Signed-off-by: amd-ruitang3 <Rui.Tang2@amd.com>
Co-authored-by: amd-ruitang3 <Rui.Tang2@amd.com>
```
  b3caeb82
- [Bugfix][Logprobs] Fix logprobs op to support more backend (#21591) · f3a683b7
  Mengqing Cao authored Jul 25, 2025
```
Signed-off-by: MengqingCao <cmq0113@163.com>
```
  f3a683b7
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
24 Jul, 2025 11 commits

update flashinfer to v0.2.9rc1 (#21485) · 2dd72d23
weiliang authored Jul 25, 2025
```
Signed-off-by: Weiliang Liu <weiliangl@nvidia.com>
```
2dd72d23

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[Attention] Optimize FlashInfer MetadataBuilder Build call (#21137) · 61b8cea3
Lucas Wilkinson authored Jul 24, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
61b8cea3
[Feat] Allow custom naming of vLLM processes (#21445) · 6da00785
Chauncey authored Jul 24, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
6da00785
[Misc] Improve comment for DPEngineCoreActor._set_cuda_visible_devices() (#21501) · 73e3949d
Rui Qiao authored Jul 24, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
73e3949d
[v1][Core] Clean up usages of `SpecializedManager` (#21407) · fc5f756d
Zhou Fang authored Jul 24, 2025
```
Signed-off-by: Zhou Fang <fang.github@gmail.com>
```
fc5f756d

[BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61

Yinghai Lu authored Jul 23, 2025


Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

11ef7a61

Dump input metadata on crash for async scheduling (#21258) · dc2f159f
Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dc2f159f

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

[BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eec69420
[Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f3137cdd

23 Jul, 2025 5 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
22 Jul, 2025 7 commits
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- [Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further... · ed250545
  Jialin Ouyang authored Jul 22, 2025
```
[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ed250545
- [Core] Optimize update checks in LogitsProcessor (#21245) · a3223766
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a3223766
- [Bugfix] Fix eviction cached blocked logic (#21357) · 32142b3c
  Simon Mo authored Jul 22, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  32142b3c
- [Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281) · af376ca1
  Jialin Ouyang authored Jul 21, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  af376ca1
- [XPU] Enable external_launcher to serve as an executor via torchrun (#21021) · 25d585ab
  Chaojun Zhang authored Jul 22, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  25d585ab
21 Jul, 2025 2 commits
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
- [DP] Fix Prometheus Logging (#21257) · 29d1ffc5
  Robert Shaw authored Jul 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  29d1ffc5