======================= Modified FLAGS detected =======================
FLAGS(name='FLAGS_selected_gpus', current_value='4', default_value='')
=======================================================================
I0619 22:24:47.275719 27373 tcp_utils.cc:107] Retry to connect to 10.16.4.9:43062 while the server is not yet listening.
I0619 22:24:50.275892 27373 tcp_utils.cc:130] Successfully connected to 10.16.4.9:43062
I0619 22:24:50.318064 27373 process_group_nccl.cc:120] ProcessGroupNCCL pg_timeout_ 1800000
W0619 22:24:50.329497 27373 gpu_resources.cc:119] Please NOTE: device: 4, GPU Compute Capability: 90.2, Driver API Version: 50724.6, Runtime API Version: 50724.6