Commits · 16d2ad1d384e8b3d89434ae60508b26d0ce6ac99 · OpenDAS / vllm_cscc

04 Mar, 2026 1 commit

[Hardware] Replace `torch.cuda.empty_cache` with `torch.accelerator.empty_cache` (#30681) · 16d2ad1d

Kunshang Ji authored Mar 04, 2026


Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

16d2ad1d

02 Mar, 2026 1 commit
- [CI] Defining extended V1 e2e + engine tests (#35580) · ec27b36b
  Andreas Karatzas authored Mar 02, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  ec27b36b
27 Feb, 2026 1 commit
- [perf] Use pinned memory for async H2D transfer in do_mamba_copy_block (#35480) · 157722da
  Huamin Li authored Feb 27, 2026
```
Signed-off-by: Huamin Li <3ericli@gmail.com>
```
  157722da
26 Feb, 2026 1 commit
- [Core] Support `min_tokens` with speculative decoding (#32642) · d9406076
  Yiliu Dong authored Feb 27, 2026
```
Signed-off-by: qianlihuang <yiliu.dong@qq.com>
Co-authored-by: qianlihuang <yiliu.dong@qq.com>
```
  d9406076
25 Feb, 2026 2 commits
- [ROCm][CI] Extending attention backend coverage for Eagle spec decode tests (#35265) · 9571e999
  Andreas Karatzas authored Feb 25, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  9571e999
- [Tests] Add GSM8k check to SpecDec E2E tests (#34772) · ee59a7c6
  Benjamin Chislett authored Feb 25, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  ee59a7c6
14 Feb, 2026 2 commits
- [Hybrid] Enable mamba prefix cache "align" mode with async scheduling (#33997) · d5fe3f70
  Thomas Parnell authored Feb 14, 2026
```
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>
```
  d5fe3f70
- [Renderer] Move InputPreprocessor into Renderer (1/2) (#34510) · 73391a1b
  Cyrus Leung authored Feb 15, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  73391a1b
13 Feb, 2026 1 commit
- [Hybrid] Enable spec decoding in mamba cache align mode (#33705) · c027541e
  Harry Huang authored Feb 14, 2026
```
Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
```
  c027541e
12 Feb, 2026 1 commit
- [Refactor] Pass Renderer to Input Processor (#34329) · b96f7314
  Cyrus Leung authored Feb 12, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  b96f7314
05 Feb, 2026 2 commits
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
- [Minor] Include `StreamingInput` in inputs package (#33856) · add9f1fb
  Nick Hill authored Feb 04, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  add9f1fb
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
30 Jan, 2026 1 commit
- [Realtime API] Adds minimal realtime API based on websockets (#33187) · 10152d21
  Patrick von Platen authored Jan 30, 2026
```
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>
```
  10152d21
26 Jan, 2026 1 commit
- [Model] Bump transformers version for test registry (#33100) · c25dbee4
  Cyrus Leung authored Jan 27, 2026
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  c25dbee4
24 Jan, 2026 1 commit

[Feature] add session based streaming input support to v1 (#28973) · 91601ff4

Joshua Deng authored Jan 24, 2026


Signed-off-by: Joshua Deng <joshuakdeng@gmail.com>
Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

91601ff4

23 Jan, 2026 1 commit

[V1][Hybrid] Mamba Prefix Caching with align mode (#30877) · 5206e5e2

Harry Huang authored Jan 24, 2026


Signed-off-by: huanghaoyan.hhy <huanghaoyan.hhy@alibaba-inc.com>
Signed-off-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>

5206e5e2

22 Jan, 2026 1 commit
- [ROCm][CI] Lower Acceptance Len Threshold For test_draft_model_quantization (#32731) · 019e2c3b
  Micah Williamson authored Jan 21, 2026
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  019e2c3b
19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
09 Jan, 2026 2 commits

[ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in... · e02706d2

Andreas Karatzas authored Jan 09, 2026


[ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in `test_async_scheduling` (#32000)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>

e02706d2

[Async][Feat] support apply penalty or bad_words for async + spec (#30495) · 8ff4a995

zhrrr authored Jan 09, 2026


Signed-off-by: zhuhaoran <zhuhaoran.zhr@alibaba-inc.com>
Signed-off-by: izhuhaoran <izhuhaoran@qq.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

8ff4a995

06 Jan, 2026 1 commit

[Perf] Async Scheduling + Speculative Decoding + Structured Outputs (#29821) · f7008ce1

Benjamin Chislett authored Jan 06, 2026


Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Nick Hill <nickhill123@gmail.com>
Co-authored-by: Nick Hill <nickhill123@gmail.com>

f7008ce1

05 Jan, 2026 1 commit
- [Bug] Revert torch warning fix (#31585) · af9a7ec2
  Wentao Ye authored Jan 05, 2026
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  af9a7ec2
18 Dec, 2025 1 commit
- [ROCm][CI] Reduce Flakiness For test_async_scheduling Using ROCM_ATTN With FP32 (#30811) · fd8afdf3
  Micah Williamson authored Dec 17, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
  fd8afdf3
17 Dec, 2025 1 commit
- [Attention] Update tests to remove deprecated env vars (#30563) · 7eb6cb6c
  Matthew Bonanni authored Dec 17, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  7eb6cb6c
12 Dec, 2025 1 commit
- [ROCm][CI] Skip multi-GPU speculative decoding tests when insufficient GPUs available (#30527) · 783644e4
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  783644e4
11 Dec, 2025 2 commits
- Add Eagle and Eagle3 support to Transformers modeling backend (#30340) · 8781cd6b
  Harry Mellor authored Dec 11, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  8781cd6b
- [Chore] Fix torch precision warning (#30428) · d6464f26
  Wentao Ye authored Dec 10, 2025
```
Signed-off-by: yewentao256 <zhyanwentao@126.com>
```
  d6464f26
10 Dec, 2025 3 commits

[ROCm][CI] Attempt to fix the failures under a subgroup of the e2e the test group (#29358) · ed7af317

Andreas Karatzas authored Dec 09, 2025


Signed-off-by: Andreas Karatzas <akaratza@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

ed7af317

[CI] Reduce Flakiness For test_spec_decode.py::test_suffix_decoding_acceptance (#30367) · 7d80c73d
Micah Williamson authored Dec 09, 2025
```
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
```
7d80c73d

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

09 Dec, 2025 1 commit

[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix... · 83319b44

Wentao Ye authored Dec 09, 2025


[Compile] Fix torch warning `TensorFloat32 tensor cores for float32 matrix multiplication available but not enabled` (#29897)
Signed-off-by: yewentao256 <zhyanwentao@126.com>

83319b44

08 Dec, 2025 1 commit
- [ROCm][CI] Fix test_max_len.py for Rocm (#29916) · 6af70e11
  Charlie Fu authored Dec 08, 2025
```
Signed-off-by: charlifu <charlifu@amd.com>
Signed-off-by: Charlie Fu <Charlie.Fu@amd.com>
```
  6af70e11
05 Dec, 2025 1 commit
- [Bugfix][llama4_eagle] Fix missing 'lm_head' attribute (#29926) · 962d7038
  Divakar Verma authored Dec 05, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  962d7038
02 Dec, 2025 4 commits
- [CI][ROCm][tests/v1/e2e] Fix multiprocessing launch for the test (#29123) · afb1e5b3
  Divakar Verma authored Dec 02, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  afb1e5b3
- [CI][AMD] spec_decode:eagle skip FLASH_ATTN for deepseek on ROCm (#29827) · e2fbfc95
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
```
  e2fbfc95
- [CI][ROCm] Fix test_correctness_sliding_window (#29243) · a690fb5b
  Divakar Verma authored Dec 01, 2025
```
Signed-off-by: Divakar Verma <divakar.verma@amd.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>
```
  a690fb5b
- [BugFix] Preserve spec decoding uniform decode when scheduling (#29759) · 44822d7f
  Nick Hill authored Dec 01, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  44822d7f
28 Nov, 2025 1 commit

[Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97

EanWang211123 authored Nov 28, 2025


Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

37b15e97