Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
da9b523c
Unverified
Commit
da9b523c
authored
Jun 10, 2025
by
Russell Bryant
Committed by
GitHub
Jun 10, 2025
Browse files
[Docs] Note that alternative structured output backends are supported (#19426)
Signed-off-by:
Russell Bryant
<
rbryant@redhat.com
>
parent
b6553be1
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
8 deletions
+1
-8
docs/usage/v1_guide.md
docs/usage/v1_guide.md
+1
-8
No files found.
docs/usage/v1_guide.md
View file @
da9b523c
...
...
@@ -54,7 +54,7 @@ This living user guide outlines a few known **important changes and limitations*
|
**FP8 KV Cache**
|
<nobr>
🟢 Functional on Hopper devices (
[
PR #15191
](
https://github.com/vllm-project/vllm/pull/15191
)
)
</nobr>
|
|
**Spec Decode**
|
<nobr>
🚧 WIP (
[
PR #13933
](
https://github.com/vllm-project/vllm/pull/13933
)
)
</nobr>
|
|
**Prompt Logprobs with Prefix Caching**
|
<nobr>
🟡 Planned (
[
RFC #13414
](
https://github.com/vllm-project/vllm/issues/13414
)
)
</nobr>
|
|
**Structured Output Alternative Backends**
|
<nobr>
🟡 Planned
</nobr>
|
|
**Structured Output Alternative Backends**
|
<nobr>
🟢 Functional
</nobr>
|
|
**Embedding Models**
|
<nobr>
🚧 WIP (
[
PR #16188
](
https://github.com/vllm-project/vllm/pull/16188
)
)
</nobr>
|
|
**Mamba Models**
|
<nobr>
🟡 Planned
</nobr>
|
|
**Encoder-Decoder Models**
|
<nobr>
🟠 Delayed
</nobr>
|
...
...
@@ -132,13 +132,6 @@ in progress.
-
**Multimodal Models**
: V1 is almost fully compatible with V0 except that interleaved modality input is not supported yet.
See
[
here
](
https://github.com/orgs/vllm-project/projects/8
)
for the status of upcoming features and optimizations.
#### Features to Be Supported
-
**Structured Output Alternative Backends**
: Structured output alternative backends (outlines, guidance) support is planned. V1 currently
supports only the
`xgrammar:no_fallback`
mode, meaning that it will error out if the output schema is unsupported by xgrammar.
Details about the structured outputs can be found
[
here
](
https://docs.vllm.ai/en/latest/features/structured_outputs.html
)
.
#### Models to Be Supported
vLLM V1 currently excludes model architectures with the
`SupportsV0Only`
protocol,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment