Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
run.sh 346 Bytes
Newer Older
laibao's avatar
更新README.md，修改Docker镜像版本和依赖库信息，删除多个示例文件以简化项目结构。  
laibao committed
1
2
3
4
5
6
7
8
9
10
11 
rm -rf local_storage/

if [ -f "output.txt" ]; then
    rm output.txt
fi

# The directory of current script
SCRIPT_DIR=$(dirname "$(readlink -f "$0")")

VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/prefill_example.py"
VLLM_ENABLE_V1_MULTIPROCESSING=0 CUDA_VISIBLE_DEVICES=0 python3 "$SCRIPT_DIR/decode_example.py"