Commits · d2b52805f24ba63e3bc7d873f74caa17ac9ff36f · OpenDAS / vllm_cscc

25 Aug, 2025 1 commit

Frontend: Adding LM Format Enforcer support to V1 engine (#22564) · 39971db3

Noam Gat authored Aug 25, 2025


Signed-off-by: Noam Gat <noamgat@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Cyrus Leung <tlleungac@connect.ust.hk>

39971db3

22 Aug, 2025 1 commit
- [Doc]: fix various typos in multiple files (#23179) · 22cf679a
  Didier Durand authored Aug 22, 2025
```
Signed-off-by: Didier Durand <durand.didier@gmail.com>
```
  22cf679a
06 Aug, 2025 1 commit
- [Perf] Parallelize fill_bitmask to accelerate high-throughput guided decoding (#21862) · 7e6544c7
  Benjamin Chislett authored Aug 05, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
```
  7e6544c7
10 Jul, 2025 1 commit
- [V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975) · d6902ce7
  Nathan Hoos authored Jul 10, 2025
```
Signed-off-by: Nathan Hoos <thwackyy.y@gmail.com>
```
  d6902ce7
04 Jul, 2025 1 commit
- [Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365) · 4a98edff
  Aaron Pham authored Jul 04, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Nick Hill <nhill@redhat.com>
```
  4a98edff
19 Jun, 2025 1 commit

Support embedding models in V1 (#16188) · 799397ee

Maximilien de Bayser authored Jun 19, 2025


Signed-off-by: Max de Bayser <mbayser@br.ibm.com>
Signed-off-by: Max de Bayser <maxdebayser@gmail.com>
Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>
Co-authored-by: 22quinn <33176974+22quinn@users.noreply.github.com>

799397ee

03 Jun, 2025 1 commit
- [Misc] Add SPDX-FileCopyrightText (#19100) · 02f0c7b2
  Simon Mo authored Jun 03, 2025
```
Signed-off-by: simon-mo <simon.mo@hey.com>
```
  02f0c7b2
31 May, 2025 1 commit
- [Bugfix]: Fix the incompatibility issue with Structured Outputs when Thinking is disabled (#18879) · ba5111f2
  Chauncey authored May 31, 2025
```
Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>
```
  ba5111f2
14 May, 2025 1 commit

[V1] Structured Outputs + Thinking compatibility (#16577) · 2fc9075b

Aaron Pham authored May 14, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: Russell Bryant <rbryant@redhat.com>

2fc9075b

30 Apr, 2025 1 commit
- [V1][Feature] Enable Speculative Decoding with Structured Outputs (#14702) · 34120f5a
  Benjamin Chislett authored Apr 29, 2025
```
Signed-off-by: Benjamin Chislett <benjamin.chislett@centml.ai>
Signed-off-by: Benjamin Chislett <chislett.ben@gmail.com>
```
  34120f5a
29 Apr, 2025 1 commit
- Simplify (and fix) passing of guided decoding backend options (#17008) · a6977dbd
  Harry Mellor authored Apr 29, 2025
```
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
```
  a6977dbd
24 Apr, 2025 1 commit

[V1][Structured Output] Clear xgrammar compiler object when engine core shut... · b724afe3

Shanshan Shen authored Apr 24, 2025


[V1][Structured Output] Clear xgrammar compiler object when engine core shut down to avoid nanobind leaked warning (#16954)
Signed-off-by: shen-shanshan <467638484@qq.com>

b724afe3

26 Mar, 2025 1 commit
- [Refactor] Remove unnecessary backend parameter in structured output interface (#15317) · 733e7c9e
  Aaron Pham authored Mar 26, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  733e7c9e
25 Mar, 2025 1 commit

[V1] guidance backend for structured output + `auto` fallback mode (#14779) · a09ad90a

Russell Bryant authored Mar 25, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>

a09ad90a

20 Mar, 2025 1 commit
- [BugFix] Lazily import XgrammarBackend to avoid early cuda init (#15171) · c47aafa3
  Nick Hill authored Mar 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c47aafa3
18 Mar, 2025 1 commit
- [V1] Refactor Structured Output for multiple backends (#14694) · 3a1e6481
  Russell Bryant authored Mar 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3a1e6481
17 Mar, 2025 1 commit

[Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65

Aaron Pham authored Mar 17, 2025

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

c0efdd65

15 Mar, 2025 1 commit
- [V1][Structured Output] calculate vocab_size eagerly (#14851) · 4c7629ca
  Aaron Pham authored Mar 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  4c7629ca
14 Mar, 2025 1 commit
- [V1] Fix vocab size calculation for structured output (#14826) · 1140991a
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  1140991a
13 Mar, 2025 1 commit
- [V1][Core] using cached vocab_size for Structured Outputs (#14630) · 8a4a2efc
  Aaron Pham authored Mar 13, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  8a4a2efc
12 Mar, 2025 1 commit
- [V1][Core] Support MistralTokenizer for Structured Output (#14625) · 77a318bd
  Aaron Pham authored Mar 11, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  77a318bd
11 Mar, 2025 3 commits
- [V1] Delay all xgrammar usage until needed (#14616) · 61a01b27
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  61a01b27
- [V1] Remove cache from StructuredOutputManager (#14622) · 4cbf2867
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4cbf2867
- [V1] Add regex structured output support with xgrammar (#14590) · 4bf82d4b
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4bf82d4b
10 Mar, 2025 1 commit
- [V1] Prevent xgrammar from breaking TPU support (#14575) · 04421dff
  Russell Bryant authored Mar 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  04421dff
07 Mar, 2025 1 commit

[V1][Core] Support for Structured Outputs (#12388) · 80e9afb5

Aaron Pham authored Mar 07, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

80e9afb5