GitLab

* add count_nonzero function for DistTensor

* change the load method of local data
Co-authored-by: liuzichang04 <liuzichang04@meituan.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

* enable force_reload of FraudDataset

* rewrite hash_key in FraudDataset

* Added code for Rectifying (TypeError: unhashable type: 'slice') when copying file

* 1) added distributed preprocessing code to create ParMetis Input from CSV files
2) add code to run pm_dglpart on multiple machines
3) added support for recreating heteregenous graph from homo geneous graph based on dropped edges, as ParMetis currently only supports homogeneous graphs

* move to pandas

* Added comments and remove drop_duplicates as it was redundant

* Addressed Pr Comments

* Rename variable

* Added comment

* Added comment

* updated ReadMe
Co-authored-by: Ankit Garg <gaank@amazon.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

* Add pytorch-direct version

* remove

* add documentation for UnifiedTensor

* Revert "add documentation for UnifiedTensor"

This reverts commit 63ba42644d4aba197c1cb4ea4b85fa1bc43b8849.

* add UnifiedTensor documentation

* Update python/dgl/contrib/unified_tensor.py
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: shhssdm <shhssdm@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

* Split out separate generators for each thread

* Amortize cost of curand_init

* Improve readability
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

* Refactors torch dist launcher udf-wrap code to handle more python versions

* minor changes

* Update randomwalks.py

* Update randomwalks.py

FIx lint
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

* Add pytorch direct to Awesome Papers Using DGL

* update

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

* Add pytorch-direct version

* remove

* Add multi-gpu unified tensor test for pytorch

* relocate verification step to each process

* reduce number of workers

* add parameter
Co-authored-by: shhssdm <shhssdm@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.

* data pipeline user guide

* remove chapter numbers

* Update data.rst

* image in dataset userguide

* update links using ref

* modify the link of save_graphs and load_graphs in dataset user guide

* move image to s3 server.

* fix links and ref

* Hide implementations that may cause confusions to the user

* add papers

* fix number of classes in Amazon Cobuy datasets

* add two papers to Awesome paper list

* Update README.md

* add four papers

* add two papers

* Add awesome papers

* Fix index in paper list

* Add paper to paperlist

* add two papers

* add two papers

* Update README.md
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>

Rewrite the multiprocessing worker pool

DGL_LOADALL=true is not used in the code anymore.

* [model] add model example GeniePath

* improvements based on feedback

* improvements based on feedback
Co-authored-by: zhjwy9343 <6593865@qq.com>

Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: zhjwy9343 <6593865@qq.com>

* [Model] add model example CARE-GNN

* update README

* improvements based on the review feedback

* fix missing item()
Co-authored-by: zhjwy9343 <6593865@qq.com>

* fix

* fix type
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>

* make heterogeneous find_edges

* add distributed EdgeDataLoader.

* fix.

* fix a bug.

* fix bugs.

* add tests on distributed heterogeneous graph sampling.

* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>

* fix.

* fix.

* fix.

* fix.

* Fix test

* Deprecate old DistEmbedding impl, use synchronized embedding impl

* Basic imple of heterogeneous on homogenenous sampling

* make pass

* Pass C++ test

* Add python test code

* lint

* lint

* Add MultiLayerEtypeNeighborSampler

* Add unitest for single machine dataloader

* Add dist dataloader test for edge type sampler

* Fix lint

* fix

* support for per etype sample

* Fix some bug and enable distributed training with per edge sample

* fix

* Now distributed training works

* turn off some mxnet

* turn off mxnet for some dist test

* fix

* upd

* upd according to the comments

* Fix

* Fix test and now distributed works.

* upd

* upd

* Fix

* Fix bug

* remove dead code.

* upd

* Fix

* upd

* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-2-66.ec2.internal>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

Co-authored-by: JingchengYu94 <jingchengyu94@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

* add model example GCN-based Anti-Spam

* update example index

* add usage info

* improvements as per comments

* fix image invisiable problem

* add image file
Co-authored-by: zhjwy9343 <6593865@qq.com>

New readme structure

* remove redundant fill

* trigger ci

* PPIDataset

* Revert "PPIDataset"

This reverts commit 264bd0c960cfa698a7bb946dad132bf52c2d0c8a.

* Hide implementations that may cause confusions to the user

* fix number of classes in Amazon Cobuy datasets

* add four papers

* Fix doc string

* fix readme

* fix readme
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>