1. 10 Mar, 2023 1 commit
    • kylasa's avatar
      [DistDGL][TestCoverage]Added testcase for testing distributed lookup service. (#5365) · e74b3d3d
      kylasa authored
      
      
      * Added testcase for testing distributed lookup service.
      
      * Applying lintrunner patch.
      
      * Fixing CI Test environment failures.
      
      * lintrunner patch.
      
      * lintrunner patch
      
      * Fix CI Failure.
      
      * Fixing CI Test failure cases.
      
      * lintrunner patch.
      
      * lintrunner patch and CI test failure.
      
      * Restore no. of test cases.
      
      * Resolving pythonpath issues.
      
      * lintrunner patch.
      
      * updating PYTHONPATH to resolve lib path
      
      * Resolve merge conflicts
      
      * Resolving issues with PYTHONPATH env variable.
      
      * fix module path
      
      * rename utils script under test to avoid ambiguity
      
      * remove unnecessary pythonpath
      
      * fix lint error
      
      * fix lint error
      
      ---------
      Co-authored-by: default avatarRhettYing <rhett_ying@qq.com>
      e74b3d3d
  2. 06 Mar, 2023 1 commit
    • kylasa's avatar
      [DistDGL][UserEx]Sync parmetis_wrapper with changes in metadata.json (#5385) · 7b766393
      kylasa authored
      * Sync parmetis_wrapper with changes in metadata.json
      
      1. In the preprocess.py, make sure that num_partitions is defined as input argument. Also, align 'input_dir' with the input dataset. schema_file is assumed to be located inside the input_dir. Also, graph_stats.txt file is assumed to be present in the input_dir.
      
      2. Use DGL_HOME environment variable so that parmetis_wrapper command can be run anywhere.
      
      * Fix CI test failure cases.
      
      * Addressing CI review comments.
      
      * Addressing CI test failures.
      
      * Applying lintrunner patch
      7b766393
  3. 19 Feb, 2023 1 commit
  4. 15 Dec, 2022 1 commit
    • Rhett Ying's avatar
      [Dist] enable to chunk node/edge data into arbitrary number of chunks (#4930) · 9731e023
      Rhett Ying authored
      
      
      * [Dist] enable to chunk node/edge data into arbitrary number of chunks
      
      * [Dist] enable to split node/edge data into arbitrary parts
      
      * refine code
      
      * Format boolean to uint8 forcely to avoid dist.scatter failure
      
      * convert boolean to int8 before scatter and revert it after scatter
      
      * refine code
      
      * fix test
      
      * refine code
      
      * move test utilities into utils.py
      
      * update comment
      
      * fix empty data
      
      * update
      
      * update
      
      * fix empty data issue
      
      * release unnecessary mem
      
      * release unnecessary mem
      
      * release unnecessary mem
      
      * release unnecessary mem
      
      * release unnecessary mem
      
      * remove unnecessary shuffle data
      
      * separate array_split into standalone utility
      
      * add example
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      9731e023
  5. 14 Dec, 2022 1 commit
  6. 03 Oct, 2022 1 commit
    • kylasa's avatar
      ParMETIS wrapper script to enable ParMETIS to process chunked dataset format (#4605) · eae6ce2a
      kylasa authored
      * Creating ParMETIS wrapper script to run parmetis using one script from user perspective
      
      * Addressed all the CI comments from PR https://github.com/dmlc/dgl/pull/4529
      
      * Addressing CI comments.
      
      * Isort, and black changes.
      
      * Replaced python with python3
      
      * Replaced single quote with double quotes per suggestion.
      
      * Removed print statement
      
      * Addressing CI Commets.
      
      * Addressing CI review comments.
      
      * Addressing CI comments as per chime discussion with Rui
      
      * CI Comments, Black and isort changes
      
      * Align with code refactoring, black, isort and code review comments.
      
      * Addressing CI review comments, and fixing merge issues with the master branch
      
      * Updated with proper unit test skip decorator
      eae6ce2a