Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
xdb4_94051
vllm
Commits
400b8289
Unverified
Commit
400b8289
authored
Sep 18, 2023
by
Woosuk Kwon
Committed by
GitHub
Sep 18, 2023
Browse files
Add pyarrow to dependencies & Print warning on Ray import error (#1094)
parent
c1026311
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
8 additions
and
1 deletion
+8
-1
requirements.txt
requirements.txt
+1
-0
vllm/engine/ray_utils.py
vllm/engine/ray_utils.py
+7
-1
No files found.
requirements.txt
View file @
400b8289
...
...
@@ -2,6 +2,7 @@ ninja # For faster builds.
psutil
ray
>= 2.5.1
pandas
# Required for Ray data.
pyarrow
# Required for Ray data.
sentencepiece
# Required for LLaMA tokenizer.
numpy
torch
>= 2.0.0
...
...
vllm/engine/ray_utils.py
View file @
400b8289
...
...
@@ -2,6 +2,9 @@ import socket
from
typing
import
Optional
,
Tuple
,
TYPE_CHECKING
from
vllm.config
import
ParallelConfig
from
vllm.logger
import
init_logger
logger
=
init_logger
(
__name__
)
try
:
import
ray
...
...
@@ -28,7 +31,10 @@ try:
executor
=
getattr
(
self
,
method
)
return
executor
(
*
args
,
**
kwargs
)
except
ImportError
:
except
ImportError
as
e
:
logger
.
warning
(
f
"Failed to import Ray with
{
e
!
r
}
. "
"For distributed inference, please install Ray with "
"`pip install ray pandas pyarrow`."
)
ray
=
None
TorchDistributedWorker
=
None
RayWorker
=
None
# pylint: disable=invalid-name
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment