Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
65b1cbb1
Unverified
Commit
65b1cbb1
authored
Jun 30, 2025
by
redmoe-moutain
Committed by
GitHub
Jun 29, 2025
Browse files
[Model] support dots1 (#18254)
Signed-off-by:
redmoe-moutain
<
agiredmoe@gmail.com
>
parent
6c9837a7
Changes
4
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
539 additions
and
0 deletions
+539
-0
docs/models/supported_models.md
docs/models/supported_models.md
+1
-0
tests/models/registry.py
tests/models/registry.py
+2
-0
vllm/model_executor/models/dots1.py
vllm/model_executor/models/dots1.py
+535
-0
vllm/model_executor/models/registry.py
vllm/model_executor/models/registry.py
+1
-0
No files found.
docs/models/supported_models.md
View file @
65b1cbb1
...
@@ -329,6 +329,7 @@ Specified using `--task generate`.
...
@@ -329,6 +329,7 @@ Specified using `--task generate`.
|
`DeepseekForCausalLM`
| DeepSeek |
`deepseek-ai/deepseek-llm-67b-base`
,
`deepseek-ai/deepseek-llm-7b-chat`
etc. | | ✅︎ | ✅︎ |
|
`DeepseekForCausalLM`
| DeepSeek |
`deepseek-ai/deepseek-llm-67b-base`
,
`deepseek-ai/deepseek-llm-7b-chat`
etc. | | ✅︎ | ✅︎ |
|
`DeepseekV2ForCausalLM`
| DeepSeek-V2 |
`deepseek-ai/DeepSeek-V2`
,
`deepseek-ai/DeepSeek-V2-Chat`
etc. | | ✅︎ | ✅︎ |
|
`DeepseekV2ForCausalLM`
| DeepSeek-V2 |
`deepseek-ai/DeepSeek-V2`
,
`deepseek-ai/DeepSeek-V2-Chat`
etc. | | ✅︎ | ✅︎ |
|
`DeepseekV3ForCausalLM`
| DeepSeek-V3 |
`deepseek-ai/DeepSeek-V3-Base`
,
`deepseek-ai/DeepSeek-V3`
etc. | | ✅︎ | ✅︎ |
|
`DeepseekV3ForCausalLM`
| DeepSeek-V3 |
`deepseek-ai/DeepSeek-V3-Base`
,
`deepseek-ai/DeepSeek-V3`
etc. | | ✅︎ | ✅︎ |
|
`Dots1ForCausalLM`
| dots.llm1 |
`rednote-hilab/dots.llm1.base`
,
`rednote-hilab/dots.llm1.inst`
etc. | | ✅︎ | ✅︎ |
|
`ExaoneForCausalLM`
| EXAONE-3 |
`LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`ExaoneForCausalLM`
| EXAONE-3 |
`LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`FalconForCausalLM`
| Falcon |
`tiiuae/falcon-7b`
,
`tiiuae/falcon-40b`
,
`tiiuae/falcon-rw-7b`
, etc. | | ✅︎ | ✅︎ |
|
`FalconForCausalLM`
| Falcon |
`tiiuae/falcon-7b`
,
`tiiuae/falcon-40b`
,
`tiiuae/falcon-rw-7b`
, etc. | | ✅︎ | ✅︎ |
|
`FalconMambaForCausalLM`
| FalconMamba |
`tiiuae/falcon-mamba-7b`
,
`tiiuae/falcon-mamba-7b-instruct`
, etc. | | ✅︎ | ✅︎ |
|
`FalconMambaForCausalLM`
| FalconMamba |
`tiiuae/falcon-mamba-7b`
,
`tiiuae/falcon-mamba-7b-instruct`
, etc. | | ✅︎ | ✅︎ |
...
...
tests/models/registry.py
View file @
65b1cbb1
...
@@ -268,6 +268,8 @@ _TEXT_GENERATION_EXAMPLE_MODELS = {
...
@@ -268,6 +268,8 @@ _TEXT_GENERATION_EXAMPLE_MODELS = {
"Zamba2ForCausalLM"
:
_HfExamplesInfo
(
"Zyphra/Zamba2-7B-instruct"
),
"Zamba2ForCausalLM"
:
_HfExamplesInfo
(
"Zyphra/Zamba2-7B-instruct"
),
"MiMoForCausalLM"
:
_HfExamplesInfo
(
"XiaomiMiMo/MiMo-7B-RL"
,
"MiMoForCausalLM"
:
_HfExamplesInfo
(
"XiaomiMiMo/MiMo-7B-RL"
,
trust_remote_code
=
True
),
trust_remote_code
=
True
),
"Dots1ForCausalLM"
:
_HfExamplesInfo
(
"rednote-hilab/dots.llm1.inst"
,
min_transformers_version
=
"4.53"
),
# [Encoder-decoder]
# [Encoder-decoder]
"BartModel"
:
_HfExamplesInfo
(
"facebook/bart-base"
),
"BartModel"
:
_HfExamplesInfo
(
"facebook/bart-base"
),
"BartForConditionalGeneration"
:
_HfExamplesInfo
(
"facebook/bart-large-cnn"
),
"BartForConditionalGeneration"
:
_HfExamplesInfo
(
"facebook/bart-large-cnn"
),
...
...
vllm/model_executor/models/dots1.py
0 → 100644
View file @
65b1cbb1
This diff is collapsed.
Click to expand it.
vllm/model_executor/models/registry.py
View file @
65b1cbb1
...
@@ -52,6 +52,7 @@ _TEXT_GENERATION_MODELS = {
...
@@ -52,6 +52,7 @@ _TEXT_GENERATION_MODELS = {
"DeepseekForCausalLM"
:
(
"deepseek"
,
"DeepseekForCausalLM"
),
"DeepseekForCausalLM"
:
(
"deepseek"
,
"DeepseekForCausalLM"
),
"DeepseekV2ForCausalLM"
:
(
"deepseek_v2"
,
"DeepseekV2ForCausalLM"
),
"DeepseekV2ForCausalLM"
:
(
"deepseek_v2"
,
"DeepseekV2ForCausalLM"
),
"DeepseekV3ForCausalLM"
:
(
"deepseek_v2"
,
"DeepseekV3ForCausalLM"
),
"DeepseekV3ForCausalLM"
:
(
"deepseek_v2"
,
"DeepseekV3ForCausalLM"
),
"Dots1ForCausalLM"
:
(
"dots1"
,
"Dots1ForCausalLM"
),
"ExaoneForCausalLM"
:
(
"exaone"
,
"ExaoneForCausalLM"
),
"ExaoneForCausalLM"
:
(
"exaone"
,
"ExaoneForCausalLM"
),
"FalconForCausalLM"
:
(
"falcon"
,
"FalconForCausalLM"
),
"FalconForCausalLM"
:
(
"falcon"
,
"FalconForCausalLM"
),
"Fairseq2LlamaForCausalLM"
:
(
"fairseq2_llama"
,
"Fairseq2LlamaForCausalLM"
),
"Fairseq2LlamaForCausalLM"
:
(
"fairseq2_llama"
,
"Fairseq2LlamaForCausalLM"
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment