README.md 1.36 KB
Newer Older
qianyj's avatar
qianyj committed
1
# 简介
huchen's avatar
huchen committed
2

qianyj's avatar
qianyj committed
3
该测试用例用于TensorFlow分类模型性能测试,使用的数据集是imagenet。
huchen's avatar
huchen committed
4

qianyj's avatar
qianyj committed
5
* 该脚本支持horovod等分布式通信库方式
huchen's avatar
huchen committed
6

qianyj's avatar
qianyj committed
7
# 运行
8

qianyj's avatar
qianyj committed
9
## 单卡
huchen's avatar
huchen committed
10

qianyj's avatar
qianyj committed
11
    python3 ./benchmarks-master/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py --data_format=NCHW --batch_size=128 --model=resnet50 --optimizer=momentum --variable_update=parameter_server  --print_training_accuracy=true  --nodistortions --num_gpus=1 --num_epochs=90 --weight_decay=1e-4 --data_dir=$data_dir_path   --use_fp16=False --data_name=imagenet --train_dir=$save_checkpoint_path
huchen's avatar
huchen committed
12

qianyj's avatar
qianyj committed
13
## 单机多卡
huchen's avatar
huchen committed
14

qianyj's avatar
qianyj committed
15
    python3 ./benchmarks-master/scripts/tf_cnn_benchmarks/tf_cnn_benchmarks.py --data_format=NCHW --batch_size=128 --model=resnet50 --optimizer=momentum --variable_update=parameter_server  --print_training_accuracy=true  --nodistortions --num_gpus=4 --num_epochs=90 --weight_decay=1e-4 --data_dir=$data_dir_path   --use_fp16=False --data_name=imagenet --train_dir=$save_checkpoint_path
huchen's avatar
huchen committed
16

qianyj's avatar
qianyj committed
17
## 分布式多卡
huchen's avatar
huchen committed
18

qianyj's avatar
qianyj committed
19
    mpirun -np ${num_gpu} --hostfile hostfile --bind-to none scripts-run/single_process.sh
20

qianyj's avatar
qianyj committed
21
hostfile格式参考:
22

qianyj's avatar
qianyj committed
23
24
    node1 slots=4
    node2 slots=4
huchen's avatar
huchen committed
25

26
# 参考资料
qianyj's avatar
qianyj committed
27
28
[https://github.com/tensorflow/benchmarks/tree/master/scripts/tf_cnn_benchmarks](https://github.com/tensorflow/benchmarks/tree/master/scripts/tf_cnn_benchmarks)
[https://github.com/horovod/horovod](https://github.com/horovod/horovod)