Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
7f9c8902
Unverified
Commit
7f9c8902
authored
Sep 20, 2024
by
omrishiv
Committed by
GitHub
Sep 20, 2024
Browse files
[Hardware][AWS] update neuron to 2.20 (#8676)
Signed-off-by:
omrishiv
<
327609+omrishiv@users.noreply.github.com
>
parent
7c8566aa
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
4 additions
and
4 deletions
+4
-4
Dockerfile.neuron
Dockerfile.neuron
+2
-2
requirements-neuron.txt
requirements-neuron.txt
+2
-2
No files found.
Dockerfile.neuron
View file @
7f9c8902
# default base image
# default base image
ARG BASE_IMAGE="public.ecr.aws/neuron/pytorch-inference-neuronx:2.1.2-neuronx-py310-sdk2.
19.1
-ubuntu20.04"
ARG BASE_IMAGE="public.ecr.aws/neuron/pytorch-inference-neuronx:2.1.2-neuronx-py310-sdk2.
20.0
-ubuntu20.04"
FROM $BASE_IMAGE
FROM $BASE_IMAGE
...
@@ -20,7 +20,7 @@ RUN python3 -m pip install --upgrade pip
...
@@ -20,7 +20,7 @@ RUN python3 -m pip install --upgrade pip
RUN python3 -m pip install --no-cache-dir fastapi ninja tokenizers pandas
RUN python3 -m pip install --no-cache-dir fastapi ninja tokenizers pandas
RUN python3 -m pip install sentencepiece transformers==4.36.2 -U
RUN python3 -m pip install sentencepiece transformers==4.36.2 -U
RUN python3 -m pip install transformers-neuronx --extra-index-url=https://pip.repos.neuron.amazonaws.com -U
RUN python3 -m pip install transformers-neuronx --extra-index-url=https://pip.repos.neuron.amazonaws.com -U
RUN python3 -m pip install --pre neuronx-cc==2.1
2
.* --extra-index-url=https://pip.repos.neuron.amazonaws.com -U
RUN python3 -m pip install --pre neuronx-cc==2.1
5
.* --extra-index-url=https://pip.repos.neuron.amazonaws.com -U
COPY ./vllm /app/vllm/vllm
COPY ./vllm /app/vllm/vllm
COPY ./setup.py /app/vllm/setup.py
COPY ./setup.py /app/vllm/setup.py
...
...
requirements-neuron.txt
View file @
7f9c8902
...
@@ -2,6 +2,6 @@
...
@@ -2,6 +2,6 @@
-r requirements-common.txt
-r requirements-common.txt
# Dependencies for Neuron devices
# Dependencies for Neuron devices
transformers-neuronx >= 0.
9
.0
transformers-neuronx >= 0.
12
.0
torch-neuronx >= 2.1.
0
torch-neuronx >= 2.1.
2
neuronx-cc
neuronx-cc
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment