"tests/vscode:/vscode.git/clone" did not exist on "ca74ee2217e04e43311e608a2cf2a51a822db926"
  • kylasa's avatar
    Added code to support multiple-file-support feature and removed singl… (#4188) · 9948ef4d
    kylasa authored
    * Added code to support multiple-file-support feature and removed single-file-support code
    
    1. Added code to read dataset in multiple-file-format
    2. Removed code for single-file format
    
    * added files missing in the previous commit
    
    This commit includes dataset_utils.py, which reads the dataset in multiple-file-format, gloo_wrapper function calls to support exchanging dictionaries as objects and helper functions in utils.py
    
    * Update convert_partition.py
    
    Updated function call "create_metadata_json" file to include partition_id so that each rank only creates its own metadata object and later on these are accumulated on rank-0 to create graph-level metadata json file.
    
    * addressing code review comments during the CI process
    
    code changes resulting from the code review comments received during the CI process.
    
    * Code reorganization
    
    Addressing CI comments and code reorganization for easier understanding.
    
    * Removed commented out line
    
    removed commented out line.
    9948ef4d
data_shuffle.py 27.2 KB