Commits · 20228cb8514ec2f8155b94fe0af204d839238280 · OpenDAS / vllm_cscc

12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in... · e02706d2
  Andreas Karatzas authored Jan 09, 2026
```
[ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in `test_async_scheduling` (#32000)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e02706d2
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
06 Jan, 2026 1 commit

[Bugfix][ROCm] Fix Unsupported attention metadata type for speculative... · e9717801

vllmellm authored Jan 06, 2026


[Bugfix][ROCm] Fix Unsupported attention metadata type for speculative decoding in `eagle.py` (#31714)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

e9717801

05 Jan, 2026 1 commit
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
02 Jan, 2026 1 commit
- [Bugfix] Fix block size used in EAGLE slot mapping (#31540) · ea53ca5e
  Benjamin Chislett authored Jan 01, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  ea53ca5e
22 Dec, 2025 1 commit
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
11 Dec, 2025 1 commit
- [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) · 72aaac5b
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  72aaac5b
10 Dec, 2025 2 commits

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

[V1][Spec Decode] Optimize Medusa proposer to avoid GPU-CPU sync (#29723) · 03b5f940
dongbo910220 authored Dec 10, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
03b5f940

09 Dec, 2025 1 commit
- [BugFix] Fix `assert batch_descriptor.num_tokens == num_tokens_padded` (#30173) · 56037dfa
  Lucas Wilkinson authored Dec 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  56037dfa
07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
04 Dec, 2025 1 commit
- [BugFix] Fix DBO assert `assert B_block_table == B_q` (#29933) · c8ab988b
  Lucas Wilkinson authored Dec 04, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  c8ab988b
02 Dec, 2025 2 commits

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

[BugFix] Fix index error in ngram_proposer (#29779) · 81fe3f82
usberkeley authored Dec 02, 2025
```
Signed-off-by: Bradley <bradley.b.pitt@gmail.com>
```
81fe3f82

30 Nov, 2025 1 commit
- [Core] Enable `inputs_embeds_size` separate from `hidden_size` (#29741) · 64bc09ba
  Cyrus Leung authored Nov 30, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  64bc09ba
28 Nov, 2025 4 commits
- [Perf] Optimize EAGLE prepare_inputs_padded with triton kernels (#28597) · 1986de13
  Benjamin Chislett authored Nov 28, 2025
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  1986de13
- [Doc]: fixing typos in multiple files. (#29685) · fae69430
  Didier Durand authored Nov 28, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  fae69430
- [mypy] Enable type checking for more directories (#29674) · 9e6bcda3
  Cyrus Leung authored Nov 29, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  9e6bcda3
- [Multimodal][Speculative Decoding]Eagle3 mm support, enablement on qwen3vl (#29594) · 37b15e97
  EanWang211123 authored Nov 28, 2025
```
Signed-off-by: Tsai, Louie <louie.tsai@intel.com>
Signed-off-by: EanWang211123 <wangyiheng@sangfor.com.cn>
Co-authored-by: Louie Tsai <louie.tsai@intel.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
```
  37b15e97
27 Nov, 2025 1 commit
- [Attention] Update attention imports (#29540) · fc1d8be3
  Matthew Bonanni authored Nov 27, 2025
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  fc1d8be3
25 Nov, 2025 3 commits

Revert back to torch.equal over torch.allclose from #28819 (#29086) · 0231ce83
Eldar Kurtić authored Nov 25, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
0231ce83

EAGLE Support DP>1 (#26086) · 12c007e2

Rémi Delacourt authored Nov 25, 2025


Signed-off-by: Rémi Delacourt <remi@mistral.ai>
Signed-off-by: Rémi Delacourt <54138269+Flechman@users.noreply.github.com>
Signed-off-by: remi <remi@mistral.ai>

12c007e2

[Spec Decode] Add support for EAGLE3 heads that do not use_aux_hidden_states (#27688) · 5f9679a4

Hanjie Qiu authored Nov 24, 2025


Signed-off-by: hjjq <hanjieq@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Co-authored-by: Benjamin Chislett <bchislett@nvidia.com>

5f9679a4

22 Nov, 2025 1 commit
- [BugFix] Fix Eagle `IndexError: list index out of range` for even `num_speculative_tokens` (#29102) · 30d64662
  Lucas Wilkinson authored Nov 21, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  30d64662
21 Nov, 2025 1 commit
- Revert "[Redo] #26368 (#28771)" (#29121) · 30b9c677
  Jialin Ouyang authored Nov 20, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  30b9c677
20 Nov, 2025 1 commit
- [Bugfix] Fix spec decode memory regression after #28549 (#28819) · 93c8672c
  Zhewen Li authored Nov 20, 2025
```
Signed-off-by: zhewenli <zhewenli@meta.com>
```
  93c8672c
19 Nov, 2025 1 commit

Eagle: MM Cuda Graphs with MRope (#28896) · 02f5903b

Izzy Putterman authored Nov 19, 2025


Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

02f5903b

17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

15 Nov, 2025 4 commits
- Add support for Eagle with separate lm-head and embed_tokens layers (#28549) · e439c784
  Eldar Kurtić authored Nov 15, 2025
```
Signed-off-by: Eldar Kurtic <8884008+eldarkurtic@users.noreply.github.com>
```
  e439c784
- [Redo] #26368 (#28771) · 98b4d389
  Cyrus Leung authored Nov 15, 2025
```
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  98b4d389
- Revert "[Core] Performance: Use list[np.ndarray] instead of list[list… (#28773) · ac86bff8
  Nick Hill authored Nov 14, 2025
  
  ac86bff8
- [Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output... · 186352b2
  Jialin Ouyang authored Nov 14, 2025
```
[Core] Performance: Use list[np.ndarray] instead of list[list[int]] for output tokens for GC optimization (#26368)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>
```
  186352b2
13 Nov, 2025 1 commit
- Rename clashing method names for vLLM model protocol (#27583) · 97d1c993
  Harry Mellor authored Nov 13, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  97d1c993
11 Nov, 2025 1 commit

[Attention] Refactor CUDA attention backend selection logic (#24794) · b30dfa03

Matthew Bonanni authored Nov 11, 2025


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni001@gmail.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

b30dfa03

05 Nov, 2025 1 commit

[BugFix] Support EP/DP + EPLB with MTP (#25311) · e50c4546

Ilya Markov authored Nov 05, 2025


Signed-off-by: ilmarkov <markovilya197@gmail.com>
Signed-off-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Sage Moore <sage@neuralmagic.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

e50c4546

04 Nov, 2025 1 commit

[model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f

yt0428 authored Nov 05, 2025


Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

05cae69f

03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967