• kylasa's avatar
    [DIST] Message size to retrieve SHUFFLE_GLOBAL_NIDs is resulting in very large... · 4cd0a685
    kylasa authored
    [DIST] Message size to retrieve SHUFFLE_GLOBAL_NIDs is resulting in very large messages and resulting in killed process (#4790)
    
    * Send out the message to the distributed lookup service in batches.
    
    * Update function signature for allgather_sizes function call.
    
    * Removed the unnecessary if statement .
    
    * Removed logging.info message, which is not needed.
    4cd0a685
gloo_wrapper.py 6.54 KB