Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
c7e7ca7b
Commit
c7e7ca7b
authored
Aug 06, 2024
by
zhuwenwen
Browse files
update version and add gptq_kernels info
parent
58fb0c33
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
setup.py
setup.py
+1
-1
vllm/_custom_ops.py
vllm/_custom_ops.py
+1
-1
No files found.
setup.py
View file @
c7e7ca7b
...
...
@@ -313,7 +313,7 @@ def get_version_add(sha: Optional[str] = None) -> str:
vllm_root
=
os
.
path
.
dirname
(
os
.
path
.
abspath
(
__file__
))
add_version_path
=
os
.
path
.
join
(
os
.
path
.
join
(
vllm_root
,
"vllm"
),
"version.py"
)
version
=
'das.opt1
.
'
version
=
'das.opt1'
# dtk version
if
os
.
getenv
(
"ROCM_PATH"
):
...
...
vllm/_custom_ops.py
View file @
c7e7ca7b
...
...
@@ -5,7 +5,7 @@ import torch
try
:
import
gptq_kernels
except
Exception
:
print
(
"INFO:
Need to import gptq_kernel with, Please install gptq_kernels from csrc/quantization/gptq
.
\n
"
)
print
(
"INFO:
Please install gptq_kernels if you want to infer gptq model
.
\n
"
)
try
:
import
vllm._C
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment