Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
4b4eeb26
Commit
4b4eeb26
authored
Oct 24, 2024
by
zhuwenwen
Browse files
Merge remote-tracking branch 'mirror/main'
parents
2216a4e5
4fdc581f
Changes
64
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
26 additions
and
37 deletions
+26
-37
vllm/triton_utils/importing.py
vllm/triton_utils/importing.py
+7
-5
vllm/utils.py
vllm/utils.py
+3
-26
vllm/v1/engine/llm_engine.py
vllm/v1/engine/llm_engine.py
+12
-3
vllm/worker/xpu_worker.py
vllm/worker/xpu_worker.py
+4
-3
No files found.
vllm/triton_utils/importing.py
View file @
4b4eeb26
...
...
@@ -5,10 +5,12 @@ from vllm.platforms import current_platform
logger
=
init_logger
(
__name__
)
# neuron has too old torch
HAS_TRITON
=
find_spec
(
"triton"
)
is
not
None
and
not
current_platform
.
is_neuron
()
HAS_TRITON
=
(
find_spec
(
"triton"
)
is
not
None
and
not
current_platform
.
is_xpu
()
# Not compatible
and
not
current_platform
.
is_neuron
()
# neuron has too old torch
)
if
not
HAS_TRITON
:
logger
.
info
(
"Triton not installed; certain GPU-related
functions
"
" will not be available."
)
logger
.
info
(
"Triton not installed
or not compatible
; certain GPU-related"
"
functions
will not be available."
)
vllm/utils.py
View file @
4b4eeb26
This diff is collapsed.
Click to expand it.
vllm/v1/engine/llm_engine.py
View file @
4b4eeb26
This diff is collapsed.
Click to expand it.
vllm/worker/xpu_worker.py
View file @
4b4eeb26
This diff is collapsed.
Click to expand it.
Prev
1
2
3
4
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment