Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
38efa282
Unverified
Commit
38efa282
authored
Jul 14, 2025
by
ant-yy
Committed by
GitHub
Jul 14, 2025
Browse files
[Model] Add Ling implementation (#20680)
Signed-off-by:
vito.yy
<
vito.yy@antgroup.com
>
parent
e8cc53af
Changes
4
Expand all
Show whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
534 additions
and
0 deletions
+534
-0
docs/models/supported_models.md
docs/models/supported_models.md
+1
-0
tests/models/registry.py
tests/models/registry.py
+2
-0
vllm/model_executor/models/bailing_moe.py
vllm/model_executor/models/bailing_moe.py
+530
-0
vllm/model_executor/models/registry.py
vllm/model_executor/models/registry.py
+1
-0
No files found.
docs/models/supported_models.md
View file @
38efa282
...
...
@@ -316,6 +316,7 @@ Specified using `--task generate`.
|
`AquilaForCausalLM`
| Aquila, Aquila2 |
`BAAI/Aquila-7B`
,
`BAAI/AquilaChat-7B`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`ArcticForCausalLM`
| Arctic |
`Snowflake/snowflake-arctic-base`
,
`Snowflake/snowflake-arctic-instruct`
, etc. | | ✅︎ | ✅︎ |
|
`BaiChuanForCausalLM`
| Baichuan2, Baichuan |
`baichuan-inc/Baichuan2-13B-Chat`
,
`baichuan-inc/Baichuan-7B`
, etc. | ✅︎ | ✅︎ | ✅︎ |
|
`BailingMoeForCausalLM`
| Ling |
`inclusionAI/Ling-lite-1.5`
,
`inclusionAI/Ling-plus`
, etc. | | ✅︎ | ✅︎ |
|
`BambaForCausalLM`
| Bamba |
`ibm-ai-platform/Bamba-9B-fp8`
,
`ibm-ai-platform/Bamba-9B`
| ✅︎ | ✅︎ | ✅︎ |
|
`BloomForCausalLM`
| BLOOM, BLOOMZ, BLOOMChat |
`bigscience/bloom`
,
`bigscience/bloomz`
, etc. | | ✅︎ | |
|
`BartForConditionalGeneration`
| BART |
`facebook/bart-base`
,
`facebook/bart-large-cnn`
, etc. | | | |
...
...
tests/models/registry.py
View file @
38efa282
...
...
@@ -141,6 +141,8 @@ _TEXT_GENERATION_EXAMPLE_MODELS = {
trust_remote_code
=
True
),
"BaichuanForCausalLM"
:
_HfExamplesInfo
(
"baichuan-inc/Baichuan2-7B-chat"
,
trust_remote_code
=
True
),
"BailingMoeForCausalLM"
:
_HfExamplesInfo
(
"inclusionAI/Ling-lite-1.5"
,
trust_remote_code
=
True
),
"BambaForCausalLM"
:
_HfExamplesInfo
(
"ibm-ai-platform/Bamba-9B"
,
extras
=
{
"tiny"
:
"hmellor/tiny-random-BambaForCausalLM"
}),
# noqa: E501
"BloomForCausalLM"
:
_HfExamplesInfo
(
"bigscience/bloom-560m"
,
...
...
vllm/model_executor/models/bailing_moe.py
0 → 100644
View file @
38efa282
This diff is collapsed.
Click to expand it.
vllm/model_executor/models/registry.py
View file @
38efa282
...
...
@@ -41,6 +41,7 @@ _TEXT_GENERATION_MODELS = {
"BaiChuanForCausalLM"
:
(
"baichuan"
,
"BaiChuanForCausalLM"
),
# baichuan-13b, lower case 'c' in the class name
"BaichuanForCausalLM"
:
(
"baichuan"
,
"BaichuanForCausalLM"
),
"BailingMoeForCausalLM"
:
(
"bailing_moe"
,
"BailingMoeForCausalLM"
),
"BambaForCausalLM"
:
(
"bamba"
,
"BambaForCausalLM"
),
"BloomForCausalLM"
:
(
"bloom"
,
"BloomForCausalLM"
),
"ChatGLMModel"
:
(
"chatglm"
,
"ChatGLMForCausalLM"
),
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment