Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
fc017915
Unverified
Commit
fc017915
authored
Jul 15, 2025
by
Isotr0py
Committed by
GitHub
Jul 14, 2025
Browse files
[Doc] Clearer mistral3 and pixtral model support description (#20926)
Signed-off-by:
Isotr0py
<
2037008807@qq.com
>
parent
9ad0a458
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
docs/models/supported_models.md
docs/models/supported_models.md
+3
-3
No files found.
docs/models/supported_models.md
View file @
fc017915
...
@@ -581,14 +581,14 @@ Specified using `--task generate`.
...
@@ -581,14 +581,14 @@ Specified using `--task generate`.
|
`KeyeForConditionalGeneration`
| Keye-VL-8B-Preview | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`Kwai-Keye/Keye-VL-8B-Preview`
| | | ✅︎ |
|
`KeyeForConditionalGeneration`
| Keye-VL-8B-Preview | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`Kwai-Keye/Keye-VL-8B-Preview`
| | | ✅︎ |
|
`KimiVLForConditionalGeneration`
| Kimi-VL-A3B-Instruct, Kimi-VL-A3B-Thinking | T + I
<sup>
+
</sup>
|
`moonshotai/Kimi-VL-A3B-Instruct`
,
`moonshotai/Kimi-VL-A3B-Thinking`
| | | ✅︎ |
|
`KimiVLForConditionalGeneration`
| Kimi-VL-A3B-Instruct, Kimi-VL-A3B-Thinking | T + I
<sup>
+
</sup>
|
`moonshotai/Kimi-VL-A3B-Instruct`
,
`moonshotai/Kimi-VL-A3B-Thinking`
| | | ✅︎ |
|
`Llama4ForConditionalGeneration`
| Llama 4 | T + I
<sup>
+
</sup>
|
`meta-llama/Llama-4-Scout-17B-16E-Instruct`
,
`meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8`
,
`meta-llama/Llama-4-Maverick-17B-128E-Instruct`
, etc. | | ✅︎ | ✅︎ |
|
`Llama4ForConditionalGeneration`
| Llama 4 | T + I
<sup>
+
</sup>
|
`meta-llama/Llama-4-Scout-17B-16E-Instruct`
,
`meta-llama/Llama-4-Maverick-17B-128E-Instruct-FP8`
,
`meta-llama/Llama-4-Maverick-17B-128E-Instruct`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaForConditionalGeneration`
| LLaVA-1.5 | T + I
<sup>
E+
</sup>
|
`llava-hf/llava-1.5-7b-hf`
,
`TIGER-Lab/Mantis-8B-siglip-llama3`
(see note), etc. | | ✅︎ | ✅︎ |
|
`LlavaForConditionalGeneration`
| LLaVA-1.5
, Pixtral (HF Transformers)
| T + I
<sup>
E+
</sup>
|
`llava-hf/llava-1.5-7b-hf`
,
`TIGER-Lab/Mantis-8B-siglip-llama3`
(see note),
`mistral-community/pixtral-12b`
,
etc. | | ✅︎ | ✅︎ |
|
`LlavaNextForConditionalGeneration`
| LLaVA-NeXT | T + I
<sup>
E+
</sup>
|
`llava-hf/llava-v1.6-mistral-7b-hf`
,
`llava-hf/llava-v1.6-vicuna-7b-hf`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaNextForConditionalGeneration`
| LLaVA-NeXT | T + I
<sup>
E+
</sup>
|
`llava-hf/llava-v1.6-mistral-7b-hf`
,
`llava-hf/llava-v1.6-vicuna-7b-hf`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaNextVideoForConditionalGeneration`
| LLaVA-NeXT-Video | T + V |
`llava-hf/LLaVA-NeXT-Video-7B-hf`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaNextVideoForConditionalGeneration`
| LLaVA-NeXT-Video | T + V |
`llava-hf/LLaVA-NeXT-Video-7B-hf`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaOnevisionForConditionalGeneration`
| LLaVA-Onevision | T + I
<sup>
+
</sup>
+ V
<sup>
+
</sup>
|
`llava-hf/llava-onevision-qwen2-7b-ov-hf`
,
`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`
, etc. | | ✅︎ | ✅︎ |
|
`LlavaOnevisionForConditionalGeneration`
| LLaVA-Onevision | T + I
<sup>
+
</sup>
+ V
<sup>
+
</sup>
|
`llava-hf/llava-onevision-qwen2-7b-ov-hf`
,
`llava-hf/llava-onevision-qwen2-0.5b-ov-hf`
, etc. | | ✅︎ | ✅︎ |
|
`MiniCPMO`
| MiniCPM-O | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
+ A
<sup>
E+
</sup>
|
`openbmb/MiniCPM-o-2_6`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`MiniCPMO`
| MiniCPM-O | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
+ A
<sup>
E+
</sup>
|
`openbmb/MiniCPM-o-2_6`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`MiniCPMV`
| MiniCPM-V | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`openbmb/MiniCPM-V-2`
(see note),
`openbmb/MiniCPM-Llama3-V-2_5`
,
`openbmb/MiniCPM-V-2_6`
, etc. | ✅︎ | | ✅︎ |
|
`MiniCPMV`
| MiniCPM-V | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`openbmb/MiniCPM-V-2`
(see note),
`openbmb/MiniCPM-Llama3-V-2_5`
,
`openbmb/MiniCPM-V-2_6`
, etc. | ✅︎ | | ✅︎ |
|
`MiniMaxVL01ForConditionalGeneration`
| MiniMax-VL | T + I
<sup>
E+
</sup>
|
`MiniMaxAI/MiniMax-VL-01`
, etc. | | ✅︎ | ✅︎ |
|
`MiniMaxVL01ForConditionalGeneration`
| MiniMax-VL | T + I
<sup>
E+
</sup>
|
`MiniMaxAI/MiniMax-VL-01`
, etc. | | ✅︎ | ✅︎ |
|
`Mistral3ForConditionalGeneration`
| Mistral3 | T + I
<sup>
+
</sup>
|
`mistralai/Mistral-Small-3.1-24B-Instruct-2503`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`Mistral3ForConditionalGeneration`
| Mistral3
(HF Transformers)
| T + I
<sup>
+
</sup>
|
`mistralai/Mistral-Small-3.1-24B-Instruct-2503`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`MllamaForConditionalGeneration`
| Llama 3.2 | T + I
<sup>
+
</sup>
|
`meta-llama/Llama-3.2-90B-Vision-Instruct`
,
`meta-llama/Llama-3.2-11B-Vision`
, etc. | | | |
|
`MllamaForConditionalGeneration`
| Llama 3.2 | T + I
<sup>
+
</sup>
|
`meta-llama/Llama-3.2-90B-Vision-Instruct`
,
`meta-llama/Llama-3.2-11B-Vision`
, etc. | | | |
|
`MolmoForCausalLM`
| Molmo | T + I
<sup>
+
</sup>
|
`allenai/Molmo-7B-D-0924`
,
`allenai/Molmo-7B-O-0924`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`MolmoForCausalLM`
| Molmo | T + I
<sup>
+
</sup>
|
`allenai/Molmo-7B-D-0924`
,
`allenai/Molmo-7B-O-0924`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`NVLM_D_Model`
| NVLM-D 1.0 | T + I
<sup>
+
</sup>
|
`nvidia/NVLM-D-72B`
, etc. | | ✅︎ | ✅︎ |
|
`NVLM_D_Model`
| NVLM-D 1.0 | T + I
<sup>
+
</sup>
|
`nvidia/NVLM-D-72B`
, etc. | | ✅︎ | ✅︎ |
...
@@ -596,7 +596,7 @@ Specified using `--task generate`.
...
@@ -596,7 +596,7 @@ Specified using `--task generate`.
|
`PaliGemmaForConditionalGeneration`
| PaliGemma, PaliGemma 2 | T + I
<sup>
E
</sup>
|
`google/paligemma-3b-pt-224`
,
`google/paligemma-3b-mix-224`
,
`google/paligemma2-3b-ft-docci-448`
, etc. | | ✅︎ | ⚠️ |
|
`PaliGemmaForConditionalGeneration`
| PaliGemma, PaliGemma 2 | T + I
<sup>
E
</sup>
|
`google/paligemma-3b-pt-224`
,
`google/paligemma-3b-mix-224`
,
`google/paligemma2-3b-ft-docci-448`
, etc. | | ✅︎ | ⚠️ |
|
`Phi3VForCausalLM`
| Phi-3-Vision, Phi-3.5-Vision | T + I
<sup>
E+
</sup>
|
`microsoft/Phi-3-vision-128k-instruct`
,
`microsoft/Phi-3.5-vision-instruct`
, etc. | | ✅︎ | ✅︎ |
|
`Phi3VForCausalLM`
| Phi-3-Vision, Phi-3.5-Vision | T + I
<sup>
E+
</sup>
|
`microsoft/Phi-3-vision-128k-instruct`
,
`microsoft/Phi-3.5-vision-instruct`
, etc. | | ✅︎ | ✅︎ |
|
`Phi4MMForCausalLM`
| Phi-4-multimodal | T + I
<sup>
+
</sup>
/ T + A
<sup>
+
</sup>
/ I
<sup>
+
</sup>
+ A
<sup>
+
</sup>
|
`microsoft/Phi-4-multimodal-instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`Phi4MMForCausalLM`
| Phi-4-multimodal | T + I
<sup>
+
</sup>
/ T + A
<sup>
+
</sup>
/ I
<sup>
+
</sup>
+ A
<sup>
+
</sup>
|
`microsoft/Phi-4-multimodal-instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`PixtralForConditionalGeneration`
|
Pixtral
| T + I
<sup>
+
</sup>
|
`mistralai/Mistral-Small-3.1-24B-Instruct-2503`
,
`mistral
-community/p
ixtral-12
b
`
, etc. | | ✅︎ | ✅︎ |
|
`PixtralForConditionalGeneration`
|
Mistral 3 (Mistral format), Pixtral (Mistral format)
| T + I
<sup>
+
</sup>
|
`mistralai/Mistral-Small-3.1-24B-Instruct-2503`
,
`mistral
ai/P
ixtral-12
B-2409
`
, etc. | | ✅︎ | ✅︎ |
|
`QwenVLForConditionalGeneration`
<sup>
^
</sup>
| Qwen-VL | T + I
<sup>
E+
</sup>
|
`Qwen/Qwen-VL`
,
`Qwen/Qwen-VL-Chat`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`QwenVLForConditionalGeneration`
<sup>
^
</sup>
| Qwen-VL | T + I
<sup>
E+
</sup>
|
`Qwen/Qwen-VL`
,
`Qwen/Qwen-VL-Chat`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`Qwen2AudioForConditionalGeneration`
| Qwen2-Audio | T + A
<sup>
+
</sup>
|
`Qwen/Qwen2-Audio-7B-Instruct`
| | ✅︎ | ✅︎ |
|
`Qwen2AudioForConditionalGeneration`
| Qwen2-Audio | T + A
<sup>
+
</sup>
|
`Qwen/Qwen2-Audio-7B-Instruct`
| | ✅︎ | ✅︎ |
|
`Qwen2VLForConditionalGeneration`
| QVQ, Qwen2-VL | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`Qwen/QVQ-72B-Preview`
,
`Qwen/Qwen2-VL-7B-Instruct`
,
`Qwen/Qwen2-VL-72B-Instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`Qwen2VLForConditionalGeneration`
| QVQ, Qwen2-VL | T + I
<sup>
E+
</sup>
+ V
<sup>
E+
</sup>
|
`Qwen/QVQ-72B-Preview`
,
`Qwen/Qwen2-VL-7B-Instruct`
,
`Qwen/Qwen2-VL-72B-Instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment