1. 05 Jul, 2022 1 commit
    • kylasa's avatar
      Added code to support multiple-file-support feature and removed singl… (#4188) · 9948ef4d
      kylasa authored
      * Added code to support multiple-file-support feature and removed single-file-support code
      
      1. Added code to read dataset in multiple-file-format
      2. Removed code for single-file format
      
      * added files missing in the previous commit
      
      This commit includes dataset_utils.py, which reads the dataset in multiple-file-format, gloo_wrapper function calls to support exchanging dictionaries as objects and helper functions in utils.py
      
      * Update convert_partition.py
      
      Updated function call "create_metadata_json" file to include partition_id so that each rank only creates its own metadata object and later on these are accumulated on rank-0 to create graph-level metadata json file.
      
      * addressing code review comments during the CI process
      
      code changes resulting from the code review comments received during the CI process.
      
      * Code reorganization
      
      Addressing CI comments and code reorganization for easier understanding.
      
      * Removed commented out line
      
      removed commented out line.
      9948ef4d