Bug: Fix Bug - Add barrier before 'destroy_process_group' in model benchmarks (#198)
**Description** Add barrier before 'destroy_process_group' to resolve the bug due to when multi models in one model benchmark, some processes haven't finished the previous process group while others failed to initialize new process group for the next model on rocm4.x when running bert_models. **Major Revision** - Add barrier before 'destroy_process_group'.
Showing
Please register or sign in to comment