Commits · edc4562571196dc3d74f4bd8960c1e15500ffe2c · OpenDAS / vllm_cscc

"vscode:/vscode.git/clone" did not exist on "27b50f1fe6e325f73b405263c3ac1fc668531118"

05 Aug, 2025 3 commits
- [feat]优化mtp相关函数返回类型 · edc45625
  zhuwenwen authored Aug 05, 2025
  
  edc45625
- [feat]1.支持mtp模型 full_cuda_graph; 2.优化mtp拒绝采样 · 93fae6b1
  zhuwenwen authored Aug 05, 2025
  
  93fae6b1
- add tbo on v1 engine · 3d57a0d3
  zhuwenwen authored Aug 05, 2025
  
  3d57a0d3
01 Aug, 2025 3 commits
- update num_rejected_tokens and num_speculative_tokens · e3cacb3b
  zhuwenwen authored Aug 01, 2025
  
  e3cacb3b
- remove num_speculative_tokens init val · 54ab90dd
  zhuwenwen authored Aug 01, 2025
  
  54ab90dd
- [feat]支持v1 engine mtp cudagraph · 00e13357
  zhuwenwen authored Aug 01, 2025
  
  00e13357
31 Jul, 2025 3 commits
- update unused code · 3de379de
  zhuwenwen authored Jul 31, 2025
  
  3de379de
- update List[int] and update num_rejected_tokens · f137e58c
  zhuwenwen authored Jul 31, 2025
  
  f137e58c
- update common.py · 0628e4b4
  zhuwenwen authored Jul 31, 2025
  
  0628e4b4
28 Jul, 2025 1 commit
- add v1 cpm support · 98958aed
  zhuwenwen authored Jul 28, 2025
  
  98958aed
24 Jul, 2025 7 commits

support full_cuda_graph · 8da1c576
zhuwenwen authored Jul 24, 2025

8da1c576
update fa v1 interface · f9408aff
zhuwenwen authored Jul 24, 2025

f9408aff

[BugFix] Set CUDA_VISIBLE_DEVICES before spawning the subprocesses (#21211) · 11ef7a61

Yinghai Lu authored Jul 23, 2025


Signed-off-by: Yinghai Lu <yinghai@thinkingmachines.ai>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Rui Qiao <ruisearch42@gmail.com>

11ef7a61

Dump input metadata on crash for async scheduling (#21258) · dc2f159f
Woosuk Kwon authored Jul 23, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
dc2f159f

[DP] Internal Load Balancing Per Node [`one-pod-per-node`] (#21238) · d5b981f8

Robert Shaw authored Jul 23, 2025


Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

d5b981f8

[BugFix] Fix KVConnector TP worker aggregation (#21473) · eec69420
Nick Hill authored Jul 24, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
eec69420
[Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f3137cdd

23 Jul, 2025 5 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
22 Jul, 2025 7 commits
- Add tokenization_kwargs to encode for embedding model truncation (#21033) · 44554a00
  Wang Yijun authored Jul 22, 2025
  
  44554a00
- [feat] Enable mm caching for transformers backend (#21358) · f38ee34a
  Raushan Turganbay authored Jul 22, 2025
```
Signed-off-by: raushan <raushan@huggingface.co>
```
  f38ee34a
- [Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further... · ed250545
  Jialin Ouyang authored Jul 22, 2025
```
[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  ed250545
- [Core] Optimize update checks in LogitsProcessor (#21245) · a3223766
  Jialin Ouyang authored Jul 22, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  a3223766
- [Bugfix] Fix eviction cached blocked logic (#21357) · 32142b3c
  Simon Mo authored Jul 22, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  32142b3c
- [Core] Minimize number of dict lookup in _maybe_evict_cached_block (#21281) · af376ca1
  Jialin Ouyang authored Jul 21, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  af376ca1
- [XPU] Enable external_launcher to serve as an executor via torchrun (#21021) · 25d585ab
  Chaojun Zhang authored Jul 22, 2025
```
Signed-off-by: chzhang <chaojun.zhang@intel.com>
```
  25d585ab
21 Jul, 2025 4 commits
- [v1][sampler] Inplace logprobs comparison to get the token rank (#21283) · 8d0a01a5
  Lu Fang authored Jul 21, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  8d0a01a5
- [DP] Fix Prometheus Logging (#21257) · 29d1ffc5
  Robert Shaw authored Jul 21, 2025
```
Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
```
  29d1ffc5
- [Attention] Clean up iRoPE in V1 (#21188) · 304dce7e
  Lucas Wilkinson authored Jul 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  304dce7e
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
20 Jul, 2025 2 commits
- Enable v1 metrics tests (#20953) · d1fb65bd
  Seiji Eicher authored Jul 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  d1fb65bd
- [TPU] support fp8 kv cache quantization (#19292) · 3a1d8940
  Chengji Yao authored Jul 19, 2025
```
Signed-off-by: Chengji Yao <chengjiyao@google.com>
```
  3a1d8940
19 Jul, 2025 5 commits
- [BugFix] Fix full cuda graph slot_mapping (#21228) · 2e8cbb58
  fhl2000 authored Jul 20, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  2e8cbb58
- [V0 Deprecation] Deprecate BlockSparse Attention & Phi3-Small (#21217) · 752c6ade
  Woosuk Kwon authored Jul 19, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  752c6ade
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- [bugfix] Fix auto thread-binding when world_size > 1 in CPU backend and refactor code (#21032) · e3a0e43d
  Li, Jiang authored Jul 19, 2025
```
Signed-off-by: jiang1.li <jiang1.li@intel.com>
```
  e3a0e43d