Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9def1066
Unverified
Commit
9def1066
authored
Jun 29, 2024
by
Matt Wong
Committed by
GitHub
Jun 29, 2024
Browse files
[Bugfix][CI/Build][Hardware][AMD] Install matching torchvision to fix AMD tests (#5949)
parent
75aa1442
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
14 additions
and
8 deletions
+14
-8
Dockerfile.rocm
Dockerfile.rocm
+12
-6
tests/entrypoints/test_openai_chat.py
tests/entrypoints/test_openai_chat.py
+2
-2
No files found.
Dockerfile.rocm
View file @
9def1066
...
@@ -55,16 +55,22 @@ RUN apt-get purge -y sccache; pip uninstall -y sccache; rm -f "$(which sccache)"
...
@@ -55,16 +55,22 @@ RUN apt-get purge -y sccache; pip uninstall -y sccache; rm -f "$(which sccache)"
# Install torch == 2.4.0 on ROCm
# Install torch == 2.4.0 on ROCm
RUN case "$(ls /opt | grep -Po 'rocm-[0-9]\.[0-9]')" in \
RUN case "$(ls /opt | grep -Po 'rocm-[0-9]\.[0-9]')" in \
*"rocm-5.7"*) \
*"rocm-5.7"*) \
pip uninstall -y torch \
pip uninstall -y torch torchaudio torchvision \
&& pip install --no-cache-dir --pre torch==2.4.0.dev20240612 \
&& pip install --no-cache-dir --pre \
torch==2.4.0.dev20240612 torchaudio==2.4.0.dev20240612 \
torchvision==0.19.0.dev20240612 \
--index-url https://download.pytorch.org/whl/nightly/rocm5.7;; \
--index-url https://download.pytorch.org/whl/nightly/rocm5.7;; \
*"rocm-6.0"*) \
*"rocm-6.0"*) \
pip uninstall -y torch \
pip uninstall -y torch torchaudio torchvision \
&& pip install --no-cache-dir --pre torch==2.4.0.dev20240612 \
&& pip install --no-cache-dir --pre \
torch==2.4.0.dev20240612 torchaudio==2.4.0.dev20240612 \
torchvision==0.19.0.dev20240612 \
--index-url https://download.pytorch.org/whl/nightly/rocm6.0;; \
--index-url https://download.pytorch.org/whl/nightly/rocm6.0;; \
*"rocm-6.1"*) \
*"rocm-6.1"*) \
pip uninstall -y torch \
pip uninstall -y torch torchaudio torchvision \
&& pip install --no-cache-dir --pre torch==2.4.0.dev20240612 \
&& pip install --no-cache-dir --pre \
torch==2.4.0.dev20240612 torchaudio==2.4.0.dev20240612 \
torchvision==0.19.0.dev20240612 \
--index-url https://download.pytorch.org/whl/nightly/rocm6.1;; \
--index-url https://download.pytorch.org/whl/nightly/rocm6.1;; \
*) ;; esac
*) ;; esac
...
...
tests/entrypoints/test_openai_chat.py
View file @
9def1066
...
@@ -14,7 +14,7 @@ import torch
...
@@ -14,7 +14,7 @@ import torch
from
huggingface_hub
import
snapshot_download
from
huggingface_hub
import
snapshot_download
from
openai
import
BadRequestError
from
openai
import
BadRequestError
from
..utils
import
VLLM_PATH
,
RemoteOpenAIServer
from
..utils
import
RemoteOpenAIServer
# any model with a chat template should work here
# any model with a chat template should work here
MODEL_NAME
=
"HuggingFaceH4/zephyr-7b-beta"
MODEL_NAME
=
"HuggingFaceH4/zephyr-7b-beta"
...
@@ -79,7 +79,7 @@ def zephyr_lora_files():
...
@@ -79,7 +79,7 @@ def zephyr_lora_files():
@
pytest
.
fixture
(
scope
=
"module"
)
@
pytest
.
fixture
(
scope
=
"module"
)
def
ray_ctx
():
def
ray_ctx
():
ray
.
init
(
runtime_env
=
{
"working_dir"
:
VLLM_PATH
}
)
ray
.
init
()
yield
yield
ray
.
shutdown
()
ray
.
shutdown
()
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment