Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
run_server.sh 353 Bytes
Newer Older
yangzhong's avatar
git init  
yangzhong committed
1
2
3
4
5
6
7
8
9
10
11 


CHECKPOINT_PATH="${CHECKPOINT_PATH:mistralai/Mixtral-8x7B-Instruct-v0.1}"
DATASET_PATH="${DATASET_PATH:dataset/2024_06_06_mixtral_15k_v4.pkl}"

python -u main.py --scenario Server \
		--model-path ${CHECKPOINT_PATH} \
		--user-conf user.conf \
		--total-sample-count 15000 \
		--dataset-path ${DATASET_PATH} \
		--device cpu 2>&1 | tee server_log.log