Commits · 555e7225bcb9cdf9b037ce064e48987dbc3e13a0 · OpenDAS / vllm_cscc

30 Jul, 2025 1 commit
- [v1][attention] Support Hybrid Allocator + FlashInfer (#21412) · 555e7225
  Chen Zhang authored Jul 29, 2025
```
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
```
  555e7225
29 Jul, 2025 1 commit
- [Bugfix] VLLM_V1 supports passing other compilation levels (#19340) · 04e38500
  Richard Zou authored Jul 29, 2025
```
Signed-off-by: Richard Zou <zou3519@gmail.com>
```
  04e38500
28 Jul, 2025 5 commits
- Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778) · b18b417f
  Kuntai Du authored Jul 28, 2025
```
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
```
  b18b417f
- [v1][mamba] Added mamba_type into MambaSpec (#21715) · a6c05028
  Asaf Joseph Gardin authored Jul 28, 2025
```
Signed-off-by: asafg <asafg@ai21.com>
Co-authored-by: asafg <asafg@ai21.com>
```
  a6c05028
- [BugFix] Fix ChunkedLocalAttention when the hybrid kv-cache is disabled (#21707) · 139a7f07
  Lucas Wilkinson authored Jul 28, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  139a7f07
- [V1] Exception Handling when Loading KV Cache from Remote Store (#21534) · 15a72ac4
  Adeline authored Jul 28, 2025
```
Signed-off-by: liuyumoye <adeline_ly2023@outlook.com>
Co-authored-by: liuyumoye <adeline_ly2023@outlook.com>
```
  15a72ac4
- [Deprecation][2/N] Replace `--task` with `--runner` and `--convert` (#21470) · 86ae693f
  Cyrus Leung authored Jul 28, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  86ae693f
26 Jul, 2025 2 commits
- Support encoder-only models without KV-Cache (#21270) · 1cd6eaba
  Maximilien de Bayser authored Jul 26, 2025
```
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
```
  1cd6eaba
- [Bugfix] Fix sync_and_slice_intermediate_tensors (#21537) · cea96a01
  Rui Qiao authored Jul 25, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  cea96a01
25 Jul, 2025 1 commit
- [V1] Get supported tasks from model runner instead of model config (#21585) · 46d81d69
  Cyrus Leung authored Jul 25, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  46d81d69
24 Jul, 2025 2 commits

[P/D] Support CPU Transfer in NixlConnector (#18293) · 60662849

Juncheng Gu authored Jul 24, 2025


Signed-off-by: Juncheng Gu <juncgu@gmail.com>
Signed-off-by: Richard Liu <ricliu@google.com>
Co-authored-by: Richard Liu <39319471+richardsliu@users.noreply.github.com>
Co-authored-by: Richard Liu <ricliu@google.com>

60662849

[Core] Freeze gc during cuda graph capture to speed up init (#21146) · f3137cdd
Michael Goin authored Jul 23, 2025
```
Signed-off-by: Codex <codex@openai.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
```
f3137cdd

23 Jul, 2025 5 commits
- [V0 Deprecation] Remove Prompt Adapters (#20588) · 82ec66f5
  Michael Goin authored Jul 23, 2025
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  82ec66f5
- [Core] Add `reload_weights` RPC method (#20096) · 5c9b807b
  22quinn authored Jul 23, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  5c9b807b
- [Core][Model] PrithviMAE Enablement on vLLM v1 engine (#20577) · 8560a5b2
  Christian Pinto authored Jul 23, 2025
```
Signed-off-by: Christian Pinto <christian.pinto@ibm.com>
```
  8560a5b2
- [V1] Check all pooling tasks during profiling (#21299) · f59ec35b
  Cyrus Leung authored Jul 23, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  f59ec35b
- [Sampler] Introduce logprobs mode for logging (#21398) · accac829
  Lu Fang authored Jul 23, 2025
```
Signed-off-by: Lu Fang <lufang@fb.com>
```
  accac829
21 Jul, 2025 2 commits
- [Attention] Clean up iRoPE in V1 (#21188) · 304dce7e
  Lucas Wilkinson authored Jul 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
```
  304dce7e
- [Model][1/N] Support multiple poolers at model level (#21227) · 042af0c8
  Cyrus Leung authored Jul 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  042af0c8
19 Jul, 2025 7 commits
- [BugFix] Fix full cuda graph slot_mapping (#21228) · 2e8cbb58
  fhl2000 authored Jul 20, 2025
```
Signed-off-by: fhl2000 <63384265+fhl2000@users.noreply.github.com>
```
  2e8cbb58
- [V1] [Hybrid] Enable piecewise CUDA Graph for mamba layers (#21194) · 881e3cbe
  Thomas Parnell authored Jul 19, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  881e3cbe
- [BugFix] Make PD work with Ray (#21072) · 9f414a12
  kourosh hakhamaneshi authored Jul 19, 2025
```
Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>
```
  9f414a12
- [BugFix] Fix potential cuda-graph IMA (#21196) · 59f93530
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  59f93530
- [BugFix][CPU] Fix `TorchSDPABackendImpl` doesn't have `use_irope` (#21200) · 468e2400
  Lucas Wilkinson authored Jul 19, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  468e2400
- [Core] Support Local Chunked Attention for Hybrid KV Cache (#19351) · 9a9fda14
  Lucia Fang authored Jul 19, 2025
```
Signed-off-by: Lucia Fang <fanglu@fb.com>
Signed-off-by: Lu Fang <fanglu@meta.com>
Signed-off-by: Lu Fang <fanglu@fb.com>
Co-authored-by: Lu Fang <fanglu@meta.com>
```
  9a9fda14
- Elastic Expert Parallel Initial Support (#20775) · 21793722
  Rui Qiao authored Jul 18, 2025
```
Signed-off-by: Rui Qiao <ruisearch42@gmail.com>
```
  21793722
18 Jul, 2025 3 commits
- [Core] Set pooling params based on task and model (#21128) · 45badd05
  Cyrus Leung authored Jul 18, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  45badd05
- [Misc] Make MM embedding merge interface explicit in model runner (#21147) · ba2dfbb0
  Roger Wang authored Jul 18, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.me>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
```
  ba2dfbb0
- [Attention] Make local attention backend agnostic (#21093) · 89cab4d0
  Lucas Wilkinson authored Jul 18, 2025
  
  89cab4d0
17 Jul, 2025 1 commit
- [Attention] Refactor attention metadata builder interface (#20466) · 76b49444
  Lucas Wilkinson authored Jul 17, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  76b49444
15 Jul, 2025 1 commit
- [V1] [Hybrid] Refactor mamba state shape calculation; enable V1 via cli (#20840) · 3534c39a
  Thomas Parnell authored Jul 15, 2025
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  3534c39a
14 Jul, 2025 2 commits
- [MISC] Move bind_kv_cache to worker module (#20900) · 1e9438e0
  wangxiyuan authored Jul 14, 2025
```
Signed-off-by: wangxiyuan <wangxiyuan1007@gmail.com>
```
  1e9438e0
- [Core] Add `update_config` RPC method (#20095) · 8632e831
  22quinn authored Jul 13, 2025
```
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
```
  8632e831
12 Jul, 2025 1 commit
- [Misc] Respect `no_use_tqdm_on_load` flag while capturing CUDA graph (#20834) · f56d2996
  lkchen authored Jul 11, 2025
```
Signed-off-by: Linkun <github@lkchen.net>
```
  f56d2996
11 Jul, 2025 1 commit
- [V1] Enable Mamba2 layers other than MambaMixer2 in the v1 engine (#20660) · 5d09152f
  nopperl authored Jul 11, 2025
```
Signed-off-by: nopperl <54780682+nopperl@users.noreply.github.com>
```
  5d09152f
10 Jul, 2025 2 commits
- [KVConnector] Always call connector `clear_metadata()` at end of step (#20756) · 574ad60d
  Nick Hill authored Jul 10, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: David Ben-David <sdavidbd@gmail.com>
```
  574ad60d
- [KVConnector] Aggregate finished requests on the scheduler (#19555) · cc876d0f
  Or Ozeri authored Jul 10, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
  cc876d0f
09 Jul, 2025 1 commit
- [Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434) · 6bbf1795
  B-201 authored Jul 09, 2025
```
Signed-off-by: bk-201 <joy25810@foxmail.com>
```
  6bbf1795
08 Jul, 2025 1 commit

[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow... · 72d14d0e

Sanger Steel authored Jul 08, 2025


[Frontend] [Core] Integrate Tensorizer in to S3 loading machinery, allow passing arbitrary arguments during save/load (#19619)
Signed-off-by: Sanger Steel <sangersteel@gmail.com>
Co-authored-by: Eta <esyra@coreweave.com>

72d14d0e

06 Jul, 2025 1 commit
- [BugFix][Spec Decode] Fix spec token ids in model runner (#20530) · 9528e3a0
  Woosuk Kwon authored Jul 06, 2025
```
Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
  9528e3a0