Commits · 2fa2a50bf950797cb59d48908d205c655ec02654 · OpenDAS / vllm_cscc

24 Apr, 2025 1 commit

[V1][Structured Output] Clear xgrammar compiler object when engine core shut... · b724afe3

Shanshan Shen authored Apr 24, 2025


[V1][Structured Output] Clear xgrammar compiler object when engine core shut down to avoid nanobind leaked warning (#16954)
Signed-off-by: shen-shanshan <467638484@qq.com>

b724afe3

26 Mar, 2025 1 commit
- [Refactor] Remove unnecessary backend parameter in structured output interface (#15317) · 733e7c9e
  Aaron Pham authored Mar 26, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  733e7c9e
25 Mar, 2025 1 commit

[V1] guidance backend for structured output + `auto` fallback mode (#14779) · a09ad90a

Russell Bryant authored Mar 25, 2025


Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Loc Huynh <jc1da.3011@gmail.com>
Co-authored-by: Michal Moskal <michal@moskal.me>

a09ad90a

20 Mar, 2025 1 commit
- [BugFix] Lazily import XgrammarBackend to avoid early cuda init (#15171) · c47aafa3
  Nick Hill authored Mar 19, 2025
```
Signed-off-by: Nick Hill <nhill@redhat.com>
```
  c47aafa3
18 Mar, 2025 1 commit
- [V1] Refactor Structured Output for multiple backends (#14694) · 3a1e6481
  Russell Bryant authored Mar 18, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  3a1e6481
17 Mar, 2025 1 commit

[Fix][Structured Output] using vocab_size to construct matcher (#14868) · c0efdd65

Aaron Pham authored Mar 17, 2025

Signed-off-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Robert Shaw <114415538+robertgshaw2-redhat@users.noreply.github.com>

c0efdd65

15 Mar, 2025 1 commit
- [V1][Structured Output] calculate vocab_size eagerly (#14851) · 4c7629ca
  Aaron Pham authored Mar 15, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  4c7629ca
14 Mar, 2025 1 commit
- [V1] Fix vocab size calculation for structured output (#14826) · 1140991a
  Russell Bryant authored Mar 14, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  1140991a
13 Mar, 2025 1 commit
- [V1][Core] using cached vocab_size for Structured Outputs (#14630) · 8a4a2efc
  Aaron Pham authored Mar 13, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  8a4a2efc
12 Mar, 2025 1 commit
- [V1][Core] Support MistralTokenizer for Structured Output (#14625) · 77a318bd
  Aaron Pham authored Mar 11, 2025
```
Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
```
  77a318bd
11 Mar, 2025 3 commits
- [V1] Delay all xgrammar usage until needed (#14616) · 61a01b27
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  61a01b27
- [V1] Remove cache from StructuredOutputManager (#14622) · 4cbf2867
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4cbf2867
- [V1] Add regex structured output support with xgrammar (#14590) · 4bf82d4b
  Russell Bryant authored Mar 11, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  4bf82d4b
10 Mar, 2025 1 commit
- [V1] Prevent xgrammar from breaking TPU support (#14575) · 04421dff
  Russell Bryant authored Mar 10, 2025
```
Signed-off-by: Russell Bryant <rbryant@redhat.com>
```
  04421dff
07 Mar, 2025 1 commit

[V1][Core] Support for Structured Outputs (#12388) · 80e9afb5

Aaron Pham authored Mar 07, 2025


Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Nick Hill <nhill@redhat.com>

80e9afb5