Skip to content

GitLab

Unverified Commit 42e932c7 authored by alexeykondrat's avatar alexeykondrat Committed by GitHub
Browse files

[CI/Build][ROCm] Enabling tensorizer tests for ROCm (#7237)

parent 076169f6
Show whitespace changes
Inline Side-by-side
Showing with 4 additions and 1 deletion
.buildkite/run-amd-test.sh
View file @ 42e932c7
...@@ -75,6 +75,7 @@ docker run \ ...@@ -75,6 +75,7 @@ docker run \
--network host \ --network host \
--shm-size=16gb \ --shm-size=16gb \
--rm \ --rm \
-e HIP_VISIBLE_DEVICES=0 \
-e HF_TOKEN \ -e HF_TOKEN \
-v ${HF_CACHE}:${HF_MOUNT} \ -v ${HF_CACHE}:${HF_MOUNT} \
-e HF_HOME=${HF_MOUNT} \ -e HF_HOME=${HF_MOUNT} \
......
.buildkite/test-pipeline.yaml
View file @ 42e932c7
...@@ -233,12 +233,13 @@ steps: ...@@ -233,12 +233,13 @@ steps:
parallelism: 4 parallelism: 4
- label: Tensorizer Test # 11min - label: Tensorizer Test # 11min
mirror_hardwares: [amd]
soft_fail: true soft_fail: true
source_file_dependencies: source_file_dependencies:
- vllm/model_executor/model_loader - vllm/model_executor/model_loader
- tests/tensorizer_loader - tests/tensorizer_loader
commands: commands:
- apt-get install -y curl libsodium23 - apt-get update && apt-get install -y curl libsodium23
- export VLLM_WORKER_MULTIPROC_METHOD=spawn - export VLLM_WORKER_MULTIPROC_METHOD=spawn
- pytest -v -s tensorizer_loader - pytest -v -s tensorizer_loader
......
requirements-rocm.txt
View file @ 42e932c7
...@@ -8,3 +8,4 @@ botocore ...@@ -8,3 +8,4 @@ botocore
ray >= 2.10.0 ray >= 2.10.0
peft peft
pytest-asyncio pytest-asyncio
tensorizer>=2.9.0
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment