Skip to content

GitLab

Unverified Commit c57d577e authored by Calvin Chen's avatar Calvin Chen Committed by GitHub
Browse files

add an absolute path for run.sh (#18258) 


Signed-off-by: default avatarcalvin chen <120380290@qq.com>
parent ca2f6b9c
Hide whitespace changes
Inline Side-by-side
Showing with 9 additions and 3 deletions
examples/offline_inference/disaggregated-prefill-v1/run.sh
View file @ c57d577e
rm -rf local_storage/
rm output.txt
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 prefill_example.py
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 decode_example.py
if [ -f "output.txt" ]; then
rm output.txt
fi
# The directory of current script
SCRIPT_DIR=$(dirname "$(readlink -f "$0")")
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/prefill_example.py"
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/decode_example.py"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment