Commits · 4e571ce6433b6768950becda40d55cb4f24741ce · OpenDAS / vllm_cscc

"docs/kubernetes/inference-gateway.md" did not exist on "7bbacce196c9058c522627e4f210286d6ebb7472"

09 Mar, 2026 1 commit
- [MTP][Misc] Clean up dead code (#36507) · 4e571ce6
  Matthew Bonanni authored Mar 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  4e571ce6
07 Mar, 2026 1 commit
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
05 Mar, 2026 1 commit
- [Bugfix] Fix block_size for hybrid model MTP (#36036) · 57c629e9
  Benjamin Chislett authored Mar 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  57c629e9
03 Mar, 2026 1 commit

[BugFix] Add support for MTP num_speculative_tokens > 1 with sparse MLA (#34552) · 28ef9ba3

Lucas Wilkinson authored Mar 03, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

28ef9ba3

02 Mar, 2026 1 commit
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
27 Feb, 2026 1 commit
- [DP] Only use DP padding when cudagraphs are actually used (#34102) · 1d532f9d
  Lucas Wilkinson authored Feb 27, 2026
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  1d532f9d
22 Feb, 2026 2 commits
- [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) · 2bcf71b9
  qizixi authored Feb 22, 2026
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  2bcf71b9
- [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) · 682566b1
  Benjamin Chislett authored Feb 22, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  682566b1
12 Feb, 2026 1 commit
- [Bugfix] Fix MTP accuracy for GLM-5 (#34385) · ec12d39d
  Michael Goin authored Feb 11, 2026
```
Signed-off-by: mgoin <mgoin64@gmail.com>
```
  ec12d39d
10 Feb, 2026 1 commit

[Misc][Spec Decode] support different load config for draft model (#34022) · 6f2f59f2

Zhengkai Zhang authored Feb 10, 2026


Signed-off-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>
Co-authored-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>

6f2f59f2

09 Feb, 2026 1 commit

[MODEL] Adding Support for Qwen3.5 Models (#34110) · 9562912c

JJJYmmm authored Feb 09, 2026


Signed-off-by: JJJYmmm <1650675829@qq.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wulipc <wulipc@users.noreply.github.com>
Co-authored-by: ywang96 <ywang96@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

9562912c

06 Feb, 2026 1 commit
- [ROCm][AITER] Fix AITER import regression for explicit backend selection (#33749) · 350ca72c
  Andreas Karatzas authored Feb 06, 2026
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  350ca72c
05 Feb, 2026 1 commit
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
02 Feb, 2026 1 commit
- fix[ROCm]: Remove unconditional aiter import (#32902) · 9eb58f8c
  Rabi Mishra authored Feb 02, 2026
```
Signed-off-by: rabi <ramishra@redhat.com>
```
  9eb58f8c
31 Jan, 2026 1 commit
- [Misc] offest -> offset in comments and variable names (#33444) · a2ef06e1
  Russell Bryant authored Jan 30, 2026
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  a2ef06e1
30 Jan, 2026 1 commit
- [CI] Enable mypy import following for `vllm/spec_decode` (#33282) · 726d8972
  Lucas Kabela authored Jan 29, 2026
```
Signed-off-by: Lucas Kabela <lucaskabela@meta.com>
```
  726d8972
27 Jan, 2026 2 commits
- feature: support eagle3 for HunyuanVL & Hunyuan (#33035) · bd92089d
  Iris authored Jan 28, 2026
```
Signed-off-by: irisliu10 <601012173@qq.com>
Signed-off-by: Iris <38269816+irisliu10@users.noreply.github.com>
```
  bd92089d
- [5/N][Attention] Finish eliminating `vllm/attention` folder (#32064) · a608b4c6
  Matthew Bonanni authored Jan 27, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  a608b4c6
26 Jan, 2026 1 commit

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

24 Jan, 2026 1 commit

[Performance] Split FlashAttn attention and cache update (#25954) · a28b94e6

ElizaWszola authored Jan 24, 2026


Signed-off-by: ElizaWszola <ewszola@redhat.com>
Signed-off-by: mgoin <mgoin64@gmail.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Luka Govedič <luka.govedic@gmail.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: mgoin <mgoin64@gmail.com>
Co-authored-by: Varun Sundar Rabindranath <varunsundar08@gmail.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>
Co-authored-by: Luka Govedič <luka.govedic@gmail.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a28b94e6

22 Jan, 2026 1 commit
- [Bugfix] Fix potential EAGLE spec decode segfault during graph capture (#32818) · c5487e2b
  Matt authored Jan 21, 2026
```
Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>
```
  c5487e2b
21 Jan, 2026 1 commit

Added qwen3 vision language moe support for speculative decoding (#32048) · 7ab80a8e

shanjiaz authored Jan 20, 2026


Signed-off-by: shanjiaz <zsjwpianpian@gmail.com>
Signed-off-by: shanjiaz <43143795+shanjiaz@users.noreply.github.com>

7ab80a8e

20 Jan, 2026 1 commit

[Misc] Remove pad_for_cudagraphs from config (#30143) · 22613408

Lucas Wilkinson authored Jan 20, 2026


Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Matthew Bonanni <mbonanni@redhat.com>

22613408

19 Jan, 2026 1 commit
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
15 Jan, 2026 1 commit
- [Bugfix] Fix stale `common_attn_metadata.max_seq_len` in speculative decoding with Eagle (#32312) · e9ec2a72
  Ofir Zafrir authored Jan 15, 2026
```
Signed-off-by: Ofir Zafrir <ofir.zafrir@intel.com>
```
  e9ec2a72
13 Jan, 2026 1 commit

[4/N][Attention] Move MLA common to model_executor (#32060) · 2263d44b

Matthew Bonanni authored Jan 13, 2026


Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Co-authored-by: Luka Govedič <ProExpertProg@users.noreply.github.com>

2263d44b

12 Jan, 2026 1 commit
- [3/N][Attention] Move AttentionMetadata-related code from utils.py to backend.py (#32054) · 20228cb8
  Matthew Bonanni authored Jan 12, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  20228cb8
09 Jan, 2026 3 commits
- [1/N][Attention] Restructure attention: move files (#31916) · 2612ba92
  Matthew Bonanni authored Jan 09, 2026
```
Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
```
  2612ba92
- [ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in... · e02706d2
  Andreas Karatzas authored Jan 09, 2026
```
[ROCm][CI][V1] Fix `nixl_connector` test failure and achieve CUDA parity in `test_async_scheduling` (#32000)
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  e02706d2
- [Cleanup] Remove obsolete spec decoding compatibility logic (#32003) · 29ce4822
  Nick Hill authored Jan 08, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  29ce4822
06 Jan, 2026 1 commit

[Bugfix][ROCm] Fix Unsupported attention metadata type for speculative... · e9717801

vllmellm authored Jan 06, 2026


[Bugfix][ROCm] Fix Unsupported attention metadata type for speculative decoding in `eagle.py` (#31714)
Signed-off-by: vllmellm <vllm.ellm@embeddedllm.com>

e9717801

05 Jan, 2026 1 commit
- [Misc] Various code simplifications (#31666) · 43e3f8e4
  Nick Hill authored Jan 04, 2026
```
Signed-off-by: njhill <nickhill123@gmail.com>
```
  43e3f8e4
02 Jan, 2026 1 commit
- [Bugfix] Fix block size used in EAGLE slot mapping (#31540) · ea53ca5e
  Benjamin Chislett authored Jan 01, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  ea53ca5e
22 Dec, 2025 1 commit
- [SpecDecode] Simplified alternative padded-speculation acceptance rate fix (#29845) · de717476
  Lucas Wilkinson authored Dec 22, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  de717476
11 Dec, 2025 1 commit
- [ROCm][Bugfix] Add MLACommonMetadata to allowed attention types for speculative decoding (#30430) · 72aaac5b
  Andreas Karatzas authored Dec 11, 2025
```
Signed-off-by: Andreas Karatzas <akaratza@amd.com>
```
  72aaac5b
10 Dec, 2025 2 commits

[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable... · abe93bce

Lucas Wilkinson authored Dec 09, 2025


[Attention] Make seq_lens_cpu optional in CommonAttentionMetadata to enable true async spec-decode (#29624)
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Signed-off-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

abe93bce

[V1][Spec Decode] Optimize Medusa proposer to avoid GPU-CPU sync (#29723) · 03b5f940
dongbo910220 authored Dec 10, 2025
```
Signed-off-by: dongbo910220 <1275604947@qq.com>
```
03b5f940

09 Dec, 2025 1 commit
- [BugFix] Fix `assert batch_descriptor.num_tokens == num_tokens_padded` (#30173) · 56037dfa
  Lucas Wilkinson authored Dec 09, 2025
```
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
```
  56037dfa
07 Dec, 2025 1 commit
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37