Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
47a0b615
Unverified
Commit
47a0b615
authored
Dec 20, 2024
by
Jiaxin Shan
Committed by
GitHub
Dec 20, 2024
Browse files
Add ray[default] to wget to run distributed inference out of box (#11265)
Signed-off-by:
Jiaxin Shan
<
seedjeffwan@gmail.com
>
parent
5d2248d8
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
2 deletions
+2
-2
Dockerfile
Dockerfile
+1
-1
requirements-cuda.txt
requirements-cuda.txt
+1
-1
No files found.
Dockerfile
View file @
47a0b615
...
...
@@ -163,7 +163,7 @@ RUN PYTHON_VERSION_STR=$(echo ${PYTHON_VERSION} | sed 's/\.//g') && \
RUN
echo
'tzdata tzdata/Areas select America'
| debconf-set-selections
\
&&
echo
'tzdata tzdata/Zones/America select Los_Angeles'
| debconf-set-selections
\
&&
apt-get update
-y
\
&&
apt-get
install
-y
ccache software-properties-common git curl
sudo
vim python3-pip
\
&&
apt-get
install
-y
ccache software-properties-common git curl
wget
sudo
vim python3-pip
\
&&
apt-get
install
-y
ffmpeg libsm6 libxext6 libgl1
\
&&
add-apt-repository ppa:deadsnakes/ppa
\
&&
apt-get update
-y
\
...
...
requirements-cuda.txt
View file @
47a0b615
...
...
@@ -2,7 +2,7 @@
-r requirements-common.txt
# Dependencies for NVIDIA GPUs
ray >= 2.9
ray
[default]
>= 2.9
nvidia-ml-py >= 12.560.30 # for pynvml package
torch == 2.5.1
# These must be updated alongside torch
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment