Commits · de71747655668d268998264365dc9bbc8e58d410 · OpenDAS / vllm_cscc

"docs/source/design/kernel/paged_attention.rst" did not exist on "27a7b070db526326ede3335fb07c1fa13ac008bb"

22 Dec, 2025 2 commits
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
- [SM100] Enable fp8 compute for prefill MLA (#30746) · b10f41c8
  Pavani Majety authored Dec 22, 2025
```
Signed-off-by: Pavani Majety <pmajety@nvidia.com>
```
  b10f41c8
19 Dec, 2025 3 commits
- Make engine core client handshake timeout configurable (#27444) · 1ab52135
  Seiji Eicher authored Dec 19, 2025
```
Signed-off-by: Seiji Eicher <seiji@anyscale.com>
```
  1ab52135
- [BugFix] Fix logprobs with spec decode and modified logits (#30846) · 2ac85a45
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  2ac85a45
- [BugFix] Handle errors when preprocessing added requests (#30895) · 45c0526a
  Nick Hill authored Dec 18, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  45c0526a
18 Dec, 2025 6 commits

Remove all2all backend envvar (#30363) · 41b6f920

Elizabeth Thomas authored Dec 18, 2025

Signed-off-by: Elizabeth Thomas <email2eliza@gmail.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

41b6f920

[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new... · 700a5ad6

Isotr0py authored Dec 19, 2025


[MM Encoder]: Migrate legacy ViT `MultiHeadAttention` to new `MMEncoderAttention` interface (#30684)
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

700a5ad6

[Bugfix] fix DP-aware routing in OpenAI API requests (#29002) · 500f26e6
inkcherry authored Dec 19, 2025
```
Signed-off-by: inkcherry <mingzhi.liu@amd.com>
```
500f26e6
[NIXL] Support P tensor-parallel-size > D tensor-parallel-size (#27274) · bc3700e0
Nicolò Lucchesi authored Dec 18, 2025
```
Signed-off-by: NickLucche <nlucches@redhat.com>
```
bc3700e0
[ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
fd8afdf3

[Metrics] Model FLOPs Utilization estimation (#30738) · a0b782f9

SungMinCho authored Dec 17, 2025


Signed-off-by: SungMinCho <tjdals4565@gmail.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

a0b782f9

17 Dec, 2025 2 commits
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
- [Fix] uniform decode batch check (#30747) · 6e9dbcc5
  Jialin Ouyang authored Dec 17, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  6e9dbcc5
16 Dec, 2025 4 commits

[Core][MM] Optimize encoder cache manager by operating with embeddings only (#30475) · f5f51e59
Roger Wang authored Dec 16, 2025
```
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Sun Kim <sunytokki@gmail.com>
```
f5f51e59
[Attention] Cache attention metadata builds across hybrid KV-cache groups (#29627) · 9fec0e13
Lucas Wilkinson authored Dec 16, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Stanislaw Wozniak <stw@zurich.ibm.com>
```
9fec0e13

[Refactor] Small refactor for group topk (#30562) · f21f5ea3

Wentao Ye authored Dec 16, 2025


Signed-off-by: yewentao256 <zhyanwentao@126.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

f21f5ea3

[feature] extend DBO to XBO (#30120) · b9ff4f2a

jiangkuaixue123 authored Dec 16, 2025


Signed-off-by: jiangkuaixue123 <jiangxiaozhou111@163.com>
Co-authored-by: root <root@hk01dgx028.cm.cluster>

b9ff4f2a

14 Dec, 2025 3 commits

CPU KV Offloading: Use more CUDA streams (#29013) · 174e39ea
Or Ozeri authored Dec 15, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
174e39ea

[NIXL][BUG FIX] Fix a bug for PD with host_buffer after merging 29665 (#30420) · ae2e503d

Chendi.Xue authored Dec 14, 2025


Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Signed-off-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>

ae2e503d

fix: Update json features supported by xGrammar (#30390) · 06089365

Johannes F authored Dec 14, 2025

Signed-off-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Signed-off-by: Johannes F <johannesflommersfeld@users.noreply.github.com>
Co-authored-by: Johannes Flommersfeld <johannes.flommersfeld@tngtech.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

06089365

12 Dec, 2025 4 commits
- [bugfix] fix bug when top_logprobs=0 with spec decoding (#30059) · d2c919dc
  realliujiaxu authored Dec 13, 2025
```
Signed-off-by: realliujiaxu <realliujiaxu@163.com>
```
  d2c919dc
- [Attention] Use sparse prefill kernel for fp8 kv-cache in DeepSeek-v3.2 (#27532) · 3e41992f
  Lucas Wilkinson authored Dec 12, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  3e41992f
- [ROCm][CI] Skip multi-GPU speculative decoding tests when insufficient GPUs available (#30527) · 783644e4
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  783644e4
- [CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that... · 48661d27
  rasmith authored Dec 11, 2025
```
[CI/Build][AMD] Skip tests in test_fusions_e2e and test_dbo_dp_ep_gsm8k that require non-existing imports for ROCm  (#30417)
Signed-off-by: Randall Smith <ransmith@amd.com>
Co-authored-by: Randall Smith <ransmith@amd.com>
```
  48661d27
11 Dec, 2025 3 commits
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [KVConnector] Add KV events to KV Connectors (#28309) · f4417f84
  Martin Hickey authored Dec 11, 2025
```
Signed-off-by: Martin Hickey <martin.hickey@ie.ibm.com>
```
  f4417f84
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26
10 Dec, 2025 5 commits

[Bugfix] fix confusing OOM errors during v1 init (#28051) · 8580919a

shivampr authored Dec 10, 2025


Signed-off-by: Shivam <shivamprasad91@gmail.com>
Signed-off-by: shivampr <shivampr.dev@gmail.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

8580919a

[P/D] KV Load Failure Recovery/Abort Configuration (#26813) · a9e4106f

Will Eaton authored Dec 10, 2025


Signed-off-by: Will Eaton <weaton@redhat.com>
Signed-off-by: Will Eaton <me@wseaton.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Mark McLoughlin <markmc@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: chaunceyjiang <chaunceyjiang@gmail.com>

a9e4106f

[ROCm][CI] Attempt to fix the failures under a subgroup of the e2e the test group (#29358) · ed7af317

Andreas Karatzas authored Dec 09, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

ed7af317

[CI] Reduce Flakiness For test_spec_decode.py::test_suffix_decoding_acceptance (#30367) · 7d80c73d
Micah Williamson authored Dec 09, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
7d80c73d

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

09 Dec, 2025 8 commits

[Cleanup] Refactor profiling env vars into a CLI config (#29912) · e858bfe0

Benjamin Chislett authored Dec 09, 2025

Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

e858bfe0

[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix... · 83319b44

Wentao Ye authored Dec 09, 2025


[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled` (#29897)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

83319b44

[BugFix] Fix `assert batch_descriptor.num_tokens == num_tokens_padded` (#30173) · 56037dfa
Lucas Wilkinson authored Dec 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
56037dfa

[Feature] Batch-Invariant Support for FA2 and LoRA (#30018) · 5dcd593b

liuquan authored Dec 09, 2025


Signed-off-by: quanliu <18646313696@163.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

5dcd593b

[Structured Output][Reasoning] Improves decoding throughput for models using... · c72ea107
Hubert de La Jonquiere authored Dec 09, 2025
```
[Structured Output][Reasoning] Improves decoding throughput for models using single-token reasoning endings. (#30056)
```
c72ea107
[CI] Fix Flaky test_eagle_max_len Test (#30306) · aeb82b19
Micah Williamson authored Dec 09, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
aeb82b19

[Attention] Make `split_decodes_and_prefills(..., require_uniform=True)` support padding (#29644) · aed84691

Lucas Wilkinson authored Dec 09, 2025


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

aed84691

kv_transfer: Rename the shared storage connectors (#30201) · 4c6fd258
Or Ozeri authored Dec 09, 2025
```
Signed-off-by: Or Ozeri <oro@il.ibm.com>
```
4c6fd258