Commits · eefa41c170d8b19e377b7adc22d591fa942cc0d1 · OpenDAS / vllm_cscc

24 Mar, 2026 1 commit
- sync v0.18.0 · eefa41c1
  zhuwenwen authored Mar 24, 2026
  
  eefa41c1
13 Mar, 2026 1 commit
- [Model Runner V2] Some code simplification (#36929) · cd32d6f5
  Nick Hill authored Mar 12, 2026
```
Signed-off-by: Nick Hill <nickhill123@gmail.com>
```
  cd32d6f5
11 Mar, 2026 2 commits

[Model Runner V2] Add probabilistic rejection sampling for spec decoding (#35461) · c77181e5
Giancarlo Delfin authored Mar 11, 2026
```
Signed-off-by: Giancarlo Delfin <gdelfin@inferact.ai>
```
c77181e5

Kimi k2.5 MLA based eagle3 (#36361) · 55738947

Jhao-Ting Chen authored Mar 11, 2026


Signed-off-by: Izzy Putterman <iputterman@nvidia.com>
Signed-off-by: Jhao-Ting Chen <jhaotingc@nvidia.com>
Co-authored-by: Izzy Putterman <iputterman@nvidia.com>

55738947

07 Mar, 2026 1 commit
- [Core] NGram GPU Implementation compatible with Async Scheduler (#29184) · a6be75db
  PatchyTIS authored Mar 08, 2026
  
  a6be75db
02 Mar, 2026 1 commit
- [Spec Decode] Add hidden states extraction system (#33736) · 9433acb8
  Fynn Schmitt-Ulms authored Mar 02, 2026
```
Signed-off-by: Fynn Schmitt-Ulms <fschmitt@redhat.com>
```
  9433acb8
24 Feb, 2026 1 commit

[Model][Spec Decode] Nemotron-H MTP and Mamba Speculative Decoding Support (#33726) · f5972a87

Benjamin Chislett authored Feb 24, 2026


Signed-off-by: Shahar Mor <smor@nvidia.com>
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Shahar Mor <smor@nvidia.com>
Co-authored-by: Roi Koren <roik@nvidia.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>

f5972a87

23 Feb, 2026 1 commit
- [CLEANING] Remove unused disable_by_batch_size from SpeculativeConfig (#35060) · aa08a30f
  Vincent Gimenes authored Feb 23, 2026
```
Signed-off-by: Vincent Gimenes <vincent.gimenes@gmail.com>
```
  aa08a30f
22 Feb, 2026 2 commits
- [Spec Decode] Reduce TP communication for speculative decoding draft token generation (#34049) · 2bcf71b9
  qizixi authored Feb 22, 2026
```
Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>
```
  2bcf71b9
- [Bug] Refactor max_num_batched_tokens to account for drafting (#34898) · 682566b1
  Benjamin Chislett authored Feb 22, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  682566b1
18 Feb, 2026 1 commit
- [Docs] Clean up speculators docs (#34065) · 64ac1395
  Kyle Sayers authored Feb 18, 2026
```
Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>
```
  64ac1395
12 Feb, 2026 1 commit
- [Model] GLM adaptation (#34124) · b3ee90f9
  Jee Jee Li authored Feb 09, 2026
```
(cherry picked from commit 978a37c8)
```
  b3ee90f9
10 Feb, 2026 1 commit

[Misc][Spec Decode] support different load config for draft model (#34022) · 6f2f59f2

Zhengkai Zhang authored Feb 10, 2026


Signed-off-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>
Co-authored-by: zzhengkai <zzhengkai@devgpu049.ldc1.facebook.com>

6f2f59f2

09 Feb, 2026 2 commits

[MODEL] Adding Support for Qwen3.5 Models (#34110) · 9562912c

JJJYmmm authored Feb 09, 2026


Signed-off-by: JJJYmmm <1650675829@qq.com>
Signed-off-by: JJJYmmm <92386084+JJJYmmm@users.noreply.github.com>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: wulipc <wulipc@users.noreply.github.com>
Co-authored-by: ywang96 <ywang96@users.noreply.github.com>
Co-authored-by: Isotr0py <Isotr0py@users.noreply.github.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Roger Wang <hey@rogerw.io>

9562912c

[Model] GLM adaptation (#34124) · 978a37c8
Jee Jee Li authored Feb 09, 2026

978a37c8

05 Feb, 2026 2 commits
- [Spec Decode] Unified Parallel Drafting (#32887) · af3162d3
  Benjamin Chislett authored Feb 05, 2026
```
Signed-off-by: Benjamin Chislett <bchislett@nvidia.com>
```
  af3162d3
- sync v0.15.1 · c721b814
  zhuwenwen authored Feb 05, 2026
  
  c721b814
03 Feb, 2026 1 commit
- Turn `@config` into a `dataclass_transform` (#31541) · 61e632ae
  Harry Mellor authored Feb 03, 2026
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  61e632ae
02 Feb, 2026 2 commits

[Models] Step-3.5-Flash (#33523) · 8b45c58f

csy0225 authored Feb 02, 2026


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: i-zhangmingming <i-zhangmingming@stepfun.com>
Co-authored-by: xiewuxun <xiewuxun@stepfun.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>
(cherry picked from commit c3b40dc3)

8b45c58f

[Models] Step-3.5-Flash (#33523) · c3b40dc3

csy0225 authored Feb 02, 2026


Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: i-zhangmingming <i-zhangmingming@stepfun.com>
Co-authored-by: xiewuxun <xiewuxun@stepfun.com>
Co-authored-by: zetaohong <i-hongzetao@stepfun.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

c3b40dc3

31 Jan, 2026 1 commit
- Add EAGLE3 support for AFMoE (#33111) · f3888aca
  AutumnAurelium authored Jan 30, 2026
```
Signed-off-by: AutumnAurelium <88015631+AutumnAurelium@users.noreply.github.com>
```
  f3888aca
27 Jan, 2026 1 commit

feature: support eagle3 for HunyuanVL & Hunyuan (#33035) · bd92089d

Iris authored Jan 28, 2026


Signed-off-by: irisliu10 <601012173@qq.com>
Signed-off-by: Iris <38269816+irisliu10@users.noreply.github.com>

bd92089d

26 Jan, 2026 1 commit

[GLM-OCR] GLM-OCR with MTP Support (#33005) · bb17e8f1

Yuxuan Zhang authored Jan 26, 2026


Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>
Co-authored-by: Isotr0py <mozf@mail2.sysu.edu.cn>

bb17e8f1

19 Jan, 2026 2 commits
- feat: spec decode with draft models (#24322) · 4a5299c9
  Tomas Ruiz authored Jan 19, 2026
```
Signed-off-by: Tomas Ruiz <tomas.ruiz.te@gmail.com>
```
  4a5299c9
- [GLM-4.7] GLM Model support for GLM-Lite (#31386) · 71832ba7
  Yuxuan Zhang authored Jan 19, 2026
```
Signed-off-by: zRzRzRzRzRzRzR <2448370773@qq.com>
Signed-off-by: Yuxuan Zhang <2448370773@qq.com>
```
  71832ba7
13 Jan, 2026 1 commit
- [BugFix]Fix eagle draft_model_config and add tests (#31753) · 80221e18
  Xingyu Liu authored Jan 12, 2026
```
Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
```
  80221e18
12 Jan, 2026 1 commit

Add K-EXAONE-236B-A23B (#31621) · 63ed2409

Kyungmin Lee authored Jan 13, 2026


Signed-off-by: lkm2835 <lkm2835@gmail.com>
Signed-off-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: lgai-exaone <exaonemodels@lgresearch.ai>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

63ed2409

08 Jan, 2026 1 commit
- [Bugfix] Remove the num_hidden_layers override for glm4_moe (#31745) · e5173d3b
  Andy Liu authored Jan 07, 2026
  
  e5173d3b
02 Jan, 2026 1 commit

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454) · 0eee877f

Xingyu Liu authored Jan 02, 2026


Signed-off-by: Xingyu Liu <charlotteliu12x@gmail.com>
Signed-off-by: Xingyu Liu <38244988+charlotte12l@users.noreply.github.com>

0eee877f

07 Dec, 2025 2 commits
- Revert "[Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145)" (#30199) · e83b7e37
  Cyrus Leung authored Dec 07, 2025
  
  e83b7e37
- [Renderer] Separate out `RendererConfig` from `ModelConfig` (#30145) · 27f4c2fd
  Cyrus Leung authored Dec 07, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  27f4c2fd
05 Dec, 2025 1 commit
- let draft model follow target model's config_format (#30152) · 77e44728
  Bangsheng Tang authored Dec 05, 2025
  
  77e44728
02 Dec, 2025 1 commit

Add Mistral Large 3 and Ministral 3 (#29757) · d8c6210e

Julien Denize authored Dec 02, 2025


Signed-off-by: Julien Denize <julien.denize@mistral.ai>
Signed-off-by: Julien Denize <40604584+juliendenize@users.noreply.github.com>
Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Signed-off-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Roger Wang <hey@rogerw.io>
Co-authored-by: Mickael Seznec <mickael@mistral.ai>

d8c6210e

26 Nov, 2025 1 commit

[Misc] Add backup hash algorithm for FIPS constrained environments (#28795) · 56531b79

George D. Torres authored Nov 25, 2025


Signed-off-by: George D. Torres <gdavtor@gmail.com>
Signed-off-by: George D. Torres <41129492+geodavic@users.noreply.github.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

56531b79

21 Nov, 2025 1 commit
- [Misc] Move dynamic seed initialization to `EngineArgs` (#29165) · d7219bcd
  Cyrus Leung authored Nov 21, 2025
```
Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
```
  d7219bcd
20 Nov, 2025 1 commit

[V0 Deprecation] Remove `num_lookahead_slots` (#29000) · 20e4497b

Cyrus Leung authored Nov 20, 2025


Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

20e4497b

17 Nov, 2025 1 commit

[Core] Async Scheduling X Spec Decoding Compatibility (#24799) · d8874c61

Ronald authored Nov 18, 2025


Signed-off-by: Ronald1995 <ronaldautomobile@163.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Benjamin Chislett <chislett.ben@gmail.com>

d8874c61

08 Nov, 2025 1 commit

Bump arctic-inference requirement (#28174) · 781f5ebf

Aurick Qiao authored Nov 07, 2025


Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
Co-authored-by: Wentao Ye <44945378+yewentao256@users.noreply.github.com>

781f5ebf

04 Nov, 2025 1 commit

[model] Add support for openPangu_Ultra_MoE (#27521) · 05cae69f

yt0428 authored Nov 05, 2025


Signed-off-by: yuantao <2422264527@qq.com>
Signed-off-by: yt0428 <51468697+yt0428@users.noreply.github.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

05cae69f

03 Nov, 2025 1 commit
- [Spec Decode] Integrate Suffix Decoding from Arctic Inference (#25784) · 2c19d967
  Aurick Qiao authored Nov 03, 2025
```
Co-authored-by: Aurick Qiao <aurick.qiao@snowflake.com>
```
  2c19d967