Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
aebfcb26
Unverified
Commit
aebfcb26
authored
Nov 09, 2023
by
GhaziSyed
Committed by
GitHub
Nov 09, 2023
Browse files
Dockerfile: Upgrade Cuda to 12.1 (#1609)
parent
ab9e8488
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
4 deletions
+4
-4
Dockerfile
Dockerfile
+4
-4
No files found.
Dockerfile
View file @
aebfcb26
FROM
nvidia/cuda:1
1.8
.0-devel-ubuntu22.04 AS dev
FROM
nvidia/cuda:1
2.1
.0-devel-ubuntu22.04 AS dev
RUN
apt-get update
-y
\
&&
apt-get
install
-y
python3-pip
...
...
@@ -9,7 +9,7 @@ WORKDIR /workspace
COPY
requirements.txt requirements.txt
RUN
--mount
=
type
=
cache,target
=
/root/.cache/pip
\
pip
install
-r
requirements.txt
# install development dependencies
COPY
requirements-dev.txt requirements-dev.txt
RUN
--mount
=
type
=
cache,target
=
/root/.cache/pip
\
...
...
@@ -26,7 +26,7 @@ COPY pyproject.toml pyproject.toml
COPY
vllm/__init__.py vllm/__init__.py
# max jobs used by Ninja to build extensions
ENV
MAX_JOBS=$max_jobs
ENV
MAX_JOBS=$max_jobs
RUN
python3 setup.py build_ext
--inplace
# image to run unit testing suite
...
...
@@ -41,7 +41,7 @@ COPY vllm vllm
ENTRYPOINT
["python3", "-m", "pytest", "tests"]
# use CUDA base as CUDA runtime dependencies are already installed via pip
FROM
nvidia/cuda:1
1.8
.0-base-ubuntu22.04 AS vllm-base
FROM
nvidia/cuda:1
2.1
.0-base-ubuntu22.04 AS vllm-base
# libnccl required for ray
RUN
apt-get update
-y
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment