"vscode:/vscode.git/clone" did not exist on "d8d208acdea43a274bd74ed27119a4f95e8e0946"
  • Da Zheng's avatar
    [Distributed] Heterogeneous graph support (#2457) · 25ac3344
    Da Zheng authored
    
    
    * Distributed heterograph (#3)
    
    * heterogeneous graph partition.
    
    * fix graph partition book for heterograph.
    
    * load heterograph partitions.
    
    * update DistGraphServer to support heterograph.
    
    * make DistGraph runnable for heterograph.
    
    * partition a graph and store parts with homogeneous graph structure.
    
    * update DistGraph server&client to use homogeneous graph.
    
    * shuffle node Ids based on node types.
    
    * load mag in heterograph.
    
    * fix per-node-type mapping.
    
    * balance node types.
    
    * fix for homogeneous graph
    
    * store etype for now.
    
    * fix data name.
    
    * fix a bug in example.
    
    * add profiler in rgcn.
    
    * heterogeneous RGCN.
    
    * map homogeneous node ids to hetero node ids.
    
    * fix graph partition book.
    
    * fix DistGraph.
    
    * shuffle eids.
    
    * verify eids and their mappings when loading a partition.
    
    * Id map from homogneous Ids to per-type Ids.
    
    * verify partitioned results.
    
    * add test for distributed sampler.
    
    * add mapping from per-type Ids to homogeneous Ids.
    
    * update example.
    
    * fix DistGraph.
    
    * Revert "add profiler in rgcn."
    
    This reverts commit 36daaed8b660933dac8f61a39faec3da2467d676.
    
    * add tests for homogeneous graphs.
    
    * fix a bug.
    
    * fix test.
    
    * fix for one partition.
    
    * fix for standalone training and evaluation.
    
    * small fix.
    
    * fix two bugs.
    
    * initialize projection matrix.
    
    * small fix on RGCN.
    
    * Fix rgcn performance (#17)
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-62-171.ec2.internal>
    
    * fix lint.
    
    * fix lint.
    
    * fix lint.
    
    * fix lint.
    
    * fix lint.
    
    * fix lint.
    
    * fix.
    
    * fix test.
    
    * fix lint.
    
    * test partitions.
    
    * remove redundant test for partitioning.
    
    * remove commented code.
    
    * fix partition.
    
    * fix tests.
    
    * fix RGCN.
    
    * fix test.
    
    * fix test.
    
    * fix test.
    
    * fix.
    
    * fix a bug.
    
    * update dmlc-core.
    
    * fix.
    
    * fix rgcn.
    
    * update readme.
    
    * add comments.
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
    Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-62-171.ec2.internal>
    
    * fix.
    
    * fix.
    
    * add div_int.
    
    * fix.
    
    * fix.
    
    * fix lint.
    
    * fix.
    
    * fix.
    
    * fix.
    
    * adjust.
    
    * move code.
    
    * handle heterograph.
    
    * return pytorch tensor in GPB.
    
    * remove some tests in example.
    
    * add to_block for distributed training.
    
    * use distributed to_block.
    
    * remove unnecessary function in DistGraph.
    
    * remove distributed to_block.
    
    * use pytorch tensor.
    
    * fix a bug in ntypes and etypes.
    
    * enable norm.
    
    * make the data loader compatible with the old format.
    
    * fix.
    
    * add comments.
    
    * fix a bug.
    
    * add test for heterograph.
    
    * support partition without reshuffle.
    
    * add test.
    
    * support partition without reshuffle.
    
    * fix.
    
    * add test.
    
    * fix bugs.
    
    * fix lint.
    
    * fix dataset.
    
    * fix for mxnet.
    
    * update docstring.
    
    * rename to floor_div
    
    * avoid exposing NodePartitionPolicy and EdgePartitionPolicy.
    
    * fix docstring.
    
    * fix error.
    
    * fixes.
    
    * fix comments.
    
    * rename.
    
    * rename.
    
    * explain IdMap.
    
    * fix docstring.
    
    * fix docstring.
    
    * update docstring.
    
    * remove the code of returning heterograph.
    
    * remove argument.
    
    * fix example.
    
    * make GraphPartitionBook an abstract class.
    
    * fix.
    
    * fix.
    
    * fix a bug.
    
    * fix a bug in example
    
    * fix a bug
    
    * reverse heterograph sampling.
    
    * temp fix.
    
    * fix lint.
    
    * Revert "temp fix."
    
    This reverts commit c450717b9f578b8c48769c675f2a19d6c1e64381.
    
    * compute norm.
    
    * Revert "reverse heterograph sampling."
    
    This reverts commit bd6deb7f52998de76508f800441ff518e2fadcb9.
    
    * fix.
    
    * move id_map.py
    
    * remove check
    
    * add more comments.
    
    * update docstring.
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-2-202.us-west-1.compute.internal>
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>
    Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
    Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-62-171.ec2.internal>
    25ac3344
test_partition.py 11.9 KB