Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
579d7a63
"vscode:/vscode.git/clone" did not exist on "899e2ef558e7345b99bc0d53c2e1c60ffdca7470"
Unverified
Commit
579d7a63
authored
Feb 15, 2025
by
Nicolò Lucchesi
Committed by
GitHub
Feb 14, 2025
Browse files
[Bugfix][Docs] Fix offline Whisper (#13274)
parent
c9f9d5b3
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
21 additions
and
1 deletion
+21
-1
docs/source/models/supported_models.md
docs/source/models/supported_models.md
+20
-0
vllm/entrypoints/llm.py
vllm/entrypoints/llm.py
+1
-1
No files found.
docs/source/models/supported_models.md
View file @
579d7a63
...
...
@@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
*
✅︎
:::
#### Transcription (`--task transcription`)
Speech2Text models trained specifically for Automatic Speech Recognition.
:::{list-table}
:widths: 25 25 25 5 5
:header-rows: 1
-
*
Architecture
*
Models
*
Example HF Models
*
[
LoRA
](
#lora-adapter
)
*
[
PP
](
#distributed-serving
)
-
*
`Whisper`
*
Whisper-based
*
`openai/whisper-large-v3-turbo`
*
🚧
*
🚧
:::
________________
_
## Model Support Policy
...
...
vllm/entrypoints/llm.py
View file @
579d7a63
...
...
@@ -421,7 +421,7 @@ class LLM:
instead pass them via the ``inputs`` parameter.
"""
runner_type
=
self
.
llm_engine
.
model_config
.
runner_type
if
runner_type
!=
"generate"
:
if
runner_type
not
in
[
"generate"
,
"transcription"
]
:
messages
=
[
"LLM.generate() is only supported for (conditional) generation "
"models (XForCausalLM, XForConditionalGeneration)."
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment