Skip to content

GitLab

Unverified Commit 45c35f0d authored by Li, Jiang's avatar Li, Jiang Committed by GitHub
Browse files

[CI/Build] Reducing CPU CI execution time (#5241)

parent 9ba093b4
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
.buildkite/run-cpu-test.sh
View file @ 45c35f0d
......@@ -11,7 +11,7 @@ trap remove_docker_container EXIT
remove_docker_container
# Run the image
docker run -itd -v ~/.cache/huggingface:/root/.cache/huggingface --network host -e HF_TOKEN --env VLLM_CPU_KVCACHE_SPACE=4 --name cpu-test cpu-test
docker run -itd -v ~/.cache/huggingface:/root/.cache/huggingface --cpuset-cpus=48-95 --cpuset-mems=1 --network host -e HF_TOKEN --env VLLM_CPU_KVCACHE_SPACE=4 --name cpu-test cpu-test
# offline inference
docker exec cpu-test bash -c "python3 examples/offline_inference.py"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment