Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
82d24f7a
Unverified
Commit
82d24f7a
authored
Dec 26, 2024
by
Simon Mo
Committed by
GitHub
Dec 26, 2024
Browse files
[Docs] Document Deepseek V3 support (#11535)
Signed-off-by:
simon-mo
<
simon.mo@hey.com
>
parent
f49777ba
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
7 additions
and
2 deletions
+7
-2
README.md
README.md
+1
-1
docs/source/models/supported_models.md
docs/source/models/supported_models.md
+6
-1
No files found.
README.md
View file @
82d24f7a
...
@@ -60,7 +60,7 @@ vLLM is flexible and easy to use with:
...
@@ -60,7 +60,7 @@ vLLM is flexible and easy to use with:
vLLM seamlessly supports most popular open-source models on HuggingFace, including:
vLLM seamlessly supports most popular open-source models on HuggingFace, including:
-
Transformer-like LLMs (e.g., Llama)
-
Transformer-like LLMs (e.g., Llama)
-
Mixture-of-Expert LLMs (e.g., Mixtral)
-
Mixture-of-Expert LLMs (e.g., Mixtral
, Deepseek-V2 and V3
)
-
Embedding Models (e.g. E5-Mistral)
-
Embedding Models (e.g. E5-Mistral)
-
Multi-modal LLMs (e.g., LLaVA)
-
Multi-modal LLMs (e.g., LLaVA)
...
...
docs/source/models/supported_models.md
View file @
82d24f7a
...
@@ -137,6 +137,11 @@ See [this page](#generative-models) for more information on how to use generativ
...
@@ -137,6 +137,11 @@ See [this page](#generative-models) for more information on how to use generativ
- :code:`deepseek-ai/DeepSeek-V2`, :code:`deepseek-ai/DeepSeek-V2-Chat` etc.
- :code:`deepseek-ai/DeepSeek-V2`, :code:`deepseek-ai/DeepSeek-V2-Chat` etc.
-
-
- ✅︎
- ✅︎
* - :code:`DeepseekV3ForCausalLM`
- DeepSeek-V3
- :code:`deepseek-ai/DeepSeek-V3-Base`, :code:`deepseek-ai/DeepSeek-V3` etc.
-
- ✅︎
* - :code:`ExaoneForCausalLM`
* - :code:`ExaoneForCausalLM`
- EXAONE-3
- EXAONE-3
- :code:`LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct`, etc.
- :code:`LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct`, etc.
...
@@ -676,7 +681,7 @@ See [this page](#generative-models) for more information on how to use generativ
...
@@ -676,7 +681,7 @@ See [this page](#generative-models) for more information on how to use generativ
- PaliGemma, PaliGemma 2
- PaliGemma, PaliGemma 2
- T + I\ :sup:`E`
- T + I\ :sup:`E`
- :code:`google/paligemma-3b-pt-224`, :code:`google/paligemma-3b-mix-224`, :code:`google/paligemma2-3b-ft-docci-448`, etc.
- :code:`google/paligemma-3b-pt-224`, :code:`google/paligemma-3b-mix-224`, :code:`google/paligemma2-3b-ft-docci-448`, etc.
-
-
- ✅︎
- ✅︎
-
-
* - :code:`Phi3VForCausalLM`
* - :code:`Phi3VForCausalLM`
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment