• Rhett Ying's avatar
    [Dist] enable to chunk node/edge data into arbitrary number of chunks (#4930) · 9731e023
    Rhett Ying authored
    
    
    * [Dist] enable to chunk node/edge data into arbitrary number of chunks
    
    * [Dist] enable to split node/edge data into arbitrary parts
    
    * refine code
    
    * Format boolean to uint8 forcely to avoid dist.scatter failure
    
    * convert boolean to int8 before scatter and revert it after scatter
    
    * refine code
    
    * fix test
    
    * refine code
    
    * move test utilities into utils.py
    
    * update comment
    
    * fix empty data
    
    * update
    
    * update
    
    * fix empty data issue
    
    * release unnecessary mem
    
    * release unnecessary mem
    
    * release unnecessary mem
    
    * release unnecessary mem
    
    * release unnecessary mem
    
    * remove unnecessary shuffle data
    
    * separate array_split into standalone utility
    
    * add example
    Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
    9731e023
utils.py 19.5 KB