Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
40677783
Unverified
Commit
40677783
authored
Mar 14, 2025
by
Richard Liu
Committed by
GitHub
Mar 14, 2025
Browse files
[CI] Add TPU v1 test (#14834)
Signed-off-by:
Richard Liu
<
ricliu@google.com
>
parent
14f301b5
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
27 additions
and
0 deletions
+27
-0
.buildkite/run-tpu-v1-test.sh
.buildkite/run-tpu-v1-test.sh
+27
-0
No files found.
.buildkite/run-tpu-v1-test.sh
0 → 100755
View file @
40677783
#!/bin/bash
set
-e
# Build the docker image.
docker build
-f
Dockerfile.tpu
-t
vllm-tpu
.
# Set up cleanup.
remove_docker_container
()
{
docker
rm
-f
tpu-test
||
true
;
}
trap
remove_docker_container EXIT
# Remove the container that might not be cleaned up in the previous run.
remove_docker_container
# For HF_TOKEN.
source
/etc/environment
# Run a simple end-to-end example.
docker run
--privileged
--net
host
--shm-size
=
16G
-it
\
-e
"HF_TOKEN=
$HF_TOKEN
"
-e
"VLLM_USE_V1=1"
--name
tpu-test
\
vllm-tpu /bin/bash
-c
"python3 -m pip install git+https://github.com/thuml/depyf.git
\
&& python3 -m pip install pytest
\
&& python3 -m pip install lm_eval[api]==0.4.4
\
&& pytest -v -s /workspace/vllm/tests/tpu/test_custom_dispatcher.py
\
&& pytest -v -s /workspace/vllm/tests/v1/tpu/test_basic.py
\
&& pytest -v -s /workspace/vllm/tests/entrypoints/llm/test_accuracy.py::test_lm_eval_accuracy_v1_engine
\
&& python3 /workspace/vllm/tests/tpu/test_compilation.py
\
&& python3 /workspace/vllm/tests/tpu/test_quantization_accuracy.py
\
&& python3 /workspace/vllm/examples/offline_inference/tpu.py"
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment