"examples/vscode:/vscode.git/clone" did not exist on "7e065eba596e1fd273c765358f5cb34468bffb17"
Unverified Commit 579d7a63 authored by Nicolò Lucchesi's avatar Nicolò Lucchesi Committed by GitHub
Browse files

[Bugfix][Docs] Fix offline Whisper (#13274)

parent c9f9d5b3
...@@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM. ...@@ -938,6 +938,26 @@ The following table lists those that are tested in vLLM.
* ✅︎ * ✅︎
::: :::
#### Transcription (`--task transcription`)
Speech2Text models trained specifically for Automatic Speech Recognition.
:::{list-table}
:widths: 25 25 25 5 5
:header-rows: 1
- * Architecture
* Models
* Example HF Models
* [LoRA](#lora-adapter)
* [PP](#distributed-serving)
- * `Whisper`
* Whisper-based
* `openai/whisper-large-v3-turbo`
* 🚧
* 🚧
:::
_________________ _________________
## Model Support Policy ## Model Support Policy
......
...@@ -421,7 +421,7 @@ class LLM: ...@@ -421,7 +421,7 @@ class LLM:
instead pass them via the ``inputs`` parameter. instead pass them via the ``inputs`` parameter.
""" """
runner_type = self.llm_engine.model_config.runner_type runner_type = self.llm_engine.model_config.runner_type
if runner_type != "generate": if runner_type not in ["generate", "transcription"]:
messages = [ messages = [
"LLM.generate() is only supported for (conditional) generation " "LLM.generate() is only supported for (conditional) generation "
"models (XForCausalLM, XForConditionalGeneration).", "models (XForCausalLM, XForConditionalGeneration).",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment