• Yuting Jiang's avatar
    Bug: Fix Bug - Add barrier before 'destroy_process_group' in model benchmarks (#198) · 7a3a4502
    Yuting Jiang authored
    **Description**
    Add barrier before 'destroy_process_group' to resolve the bug due to when multi models in one model benchmark, some processes haven't finished the previous process group while others failed to initialize new process group for the next model on rocm4.x when running bert_models.
    
    **Major Revision**
    -  Add barrier before 'destroy_process_group'.
    7a3a4502
pytorch_base.py 7.58 KB