Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
92ec5d8e
Commit
92ec5d8e
authored
Dec 25, 2024
by
zhuwenwen
Browse files
add torch2.3
parent
0afe13fb
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
6 deletions
+6
-6
README.md
README.md
+2
-2
setup.py
setup.py
+4
-4
No files found.
README.md
View file @
92ec5d8e
...
...
@@ -16,10 +16,10 @@ vLLM是一个快速且易于使用的LLM推理和服务库,使用PageAttention
| ChatGLMModel | glm-4v-9b,chatglm3,chatglm2 | Yes | No | Yes |
| DeepseekV2ForCausalLM | DeepSeek-V2 | Yes | No | - |
| BaiChuanForCausalLM | Baichuan2,Baichuan | Yes | Yes | - |
| BloomForCausalLM | BLOOM | Yes | No |
-
|
| BloomForCausalLM | BLOOM | Yes | No |
Yes
|
| InternLMForCausalLM | InternLM | Yes | No | - |
| InternLM2ForCausalLM | InternLM2 | Yes | No | - |
| FalconForCausalLM | falcon | Yes | No |
-
|
| FalconForCausalLM | falcon | Yes | No |
Yes
|
| TeleChat12BForCausalLM (#TelechatForCausalLM) | TeleChat-12B | Yes | No | - |
| MiniCPMForCausalLM | MiniCPM | Yes | No | - |
| MiniCPM3ForCausalLM | MiniCPM3 | Yes | No | - |
...
...
setup.py
View file @
92ec5d8e
...
...
@@ -375,13 +375,13 @@ def get_version_add(sha: Optional[str] = None) -> str:
if
sha
!=
'Unknown'
:
if
sha
is
None
:
sha
=
get_sha
(
vllm_root
)
#
if (major, minor) == ('2', '3'):
#
version = 'das.opt1.' + sha[:7]
if
(
major
,
minor
)
==
(
'2'
,
'3'
):
version
=
'das.opt1.'
+
sha
[:
7
]
if
(
major
,
minor
)
==
(
'2'
,
'4'
):
version
=
'das.opt2.'
+
sha
[:
7
]
else
:
#
if (major, minor) == ('2', '3'):
#
version = 'das.opt1'
if
(
major
,
minor
)
==
(
'2'
,
'3'
):
version
=
'das.opt1'
if
(
major
,
minor
)
==
(
'2'
,
'4'
):
version
=
'das.opt2'
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment