Skip to content

GitLab

Unverified Commit e76be065 authored by Łukasz Durejko's avatar Łukasz Durejko Committed by GitHub
Browse files

[Hardware][Intel-Gaudi] [CI/Build] Add tensor parallel size = 2 test to HPU CI (#18709) 


Signed-off-by: default avatarLukasz Durejko <ldurejko@habana.ai>
parent 08777500
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
.buildkite/scripts/hardware_ci/run-hpu-test.sh
View file @ e76be065
......@@ -21,4 +21,6 @@ remove_docker_container
# Run the image and launch offline inference
docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m
docker run --runtime=habana --name=hpu-test --network=host -e HABANA_VISIBLE_DEVICES=all -e VLLM_SKIP_WARMUP=true --entrypoint="" hpu-test-env python3 examples/offline_inference/basic/generate.py --model facebook/opt-125m --tensor-parallel-size 2
EXITCODE=$?
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment