1. 17 Nov, 2020 1 commit
  2. 30 Oct, 2020 1 commit
    • nv-dlasalle's avatar
      [Dataloading] Add class for copying tensors to/from the GPU on a non-default stream (#2284) · f673fc25
      nv-dlasalle authored
      * Add async transferer class
      
      * Add async ndarray copy interface
      
      * Add python bindings
      
      * Fix comment
      
      * Add python class
      
      * Fix linting issues
      
      * Add python unit test
      
      * Update python interface
      
      * move async_transferer to cuda only directory
      
      * Fix linting issue
      
      * Move out of contrib
      
      * Add doc strings
      
      * Move test compute from backend
      
      * Update comment
      
      * Fix test naming
      
      * Fix argument usage
      
      * Wrap/unwrap backend parameters
      
      * Move to dataloading
      
      * Move to 'dataloading'
      
      * Make GPU/CPU compatible
      
      * Fix unit tests
      
      * Add docs
      
      * Use only backend interface for datamovement in unit test
      f673fc25
  3. 10 Sep, 2020 1 commit
  4. 21 Aug, 2020 1 commit
  5. 19 Aug, 2020 1 commit
  6. 17 Aug, 2020 1 commit
    • Mufei Li's avatar
      [Doc/Feature] Refactor, doc update and behavior fix for graphs (#1983) · be444e52
      Mufei Li authored
      
      
      * Update graph
      
      * Fix for dgl.graph
      
      * from_scipy
      
      * Replace canonical_etypes with relations
      
      * from_networkx
      
      * Update for hetero_from_relations
      
      * Roll back the change of canonical_etypes to relations
      
      * heterograph
      
      * bipartite
      
      * Update doc
      
      * Fix lint
      
      * Fix lint
      
      * Fix test cases
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Update
      
      * Fix test
      
      * Fix
      
      * Update
      
      * Use DGLError
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Update
      
      * Fix
      
      * Update
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Update
      
      * Fix
      
      * Update
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Fix
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * rewrite sanity checks
      
      * delete unnecessary checks
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Update
      
      * Fix
      
      * Update
      
      * Fix
      
      * Fix
      
      * Update
      
      * Fix
      
      * Update
      
      * Fix
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
      Co-authored-by: default avatarQuan Gan <coin2028@hotmail.com>
      be444e52
  7. 10 Aug, 2020 1 commit
    • Da Zheng's avatar
      Fix the performance issue of graph partitioning in new DGLGraph (#1934) · 729ff2ef
      Da Zheng authored
      
      
      * fix perf.
      
      * fix.
      
      * accelerate metis.
      
      * fix lint.
      
      * use gklib.
      
      * fix perf.
      
      * fix.
      
      * update metis.
      
      * update launch script
      
      * handle synchronized API.
      
      * fix.
      
      * fix example.
      
      * fix dataloader.
      
      * temp fix.
      
      * temp fix omp.
      
      * distinguish roles.
      
      * initialize iterator of DistDataloader correctly.
      
      * check the correctness of launch script.
      
      * move feature copy to sampler.
      
      * measure mem/network copy time.
      
      * remove
      
      * Revert "measure mem/network copy time."
      
      This reverts commit 86cefdc14b7815fcf5aad6496af912dba48e4aa6.
      
      * fix.
      
      * fix
      
      * fix.
      
      * fix cmake.
      
      * disable metis in windows.
      
      * disable metis tests in windows.
      
      * remove test for multigraph.
      
      * fix test.
      
      * fix.
      
      * fix cmake.
      
      * fix.
      
      * revert.
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>
      729ff2ef
  8. 30 Jul, 2020 1 commit
  9. 28 Jul, 2020 2 commits
    • Qidong Su's avatar
      [Feature] Shared memory utilities (#1807) · 40950629
      Qidong Su authored
      
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix
      
      * update
      
      * fix
      
      * update
      
      * update
      
      * win32
      
      * update
      
      * fix
      
      * update
      
      * update
      
      * update
      
      * updat
      
      * update
      
      * update
      
      * fix
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix
      
      * TODO
      
      * 111
      
      * fix
      
      * minor fix
      
      * minor fix
      
      * fox
      
      * Update shared_mem_manager.cc
      
      * update
      
      * update
      
      * update
      
      * update metis
      
      * update metis
      
      * update
      Co-authored-by: default avatarVoVAllen <jz1749@nyu.edu>
      Co-authored-by: default avatarJinjing Zhou <VoVAllen@users.noreply.github.com>
      40950629
    • Minjie Wang's avatar
      [Refactor][Graph] Merge DGLGraph and DGLHeteroGraph (#1862) · 44089c8b
      Minjie Wang authored
      
      
      * Merge
      
      * [Graph][CUDA] Graph on GPU and many refactoring (#1791)
      
      * change edge_ids behavior and C++ impl
      
      * fix unittests; remove utils.Index in edge_id
      
      * pass mx and th tests
      
      * pass tf test
      
      * add aten::Scatter_
      
      * Add nonzero; impl CSRGetDataAndIndices/CSRSliceMatrix
      
      * CSRGetData and CSRGetDataAndIndices passed tests
      
      * CSRSliceMatrix basic tests
      
      * fix bug in empty slice
      
      * CUDA CSRHasDuplicate
      
      * has_node; has_edge_between
      
      * predecessors, successors
      
      * deprecate send/recv; fix send_and_recv
      
      * deprecate send/recv; fix send_and_recv
      
      * in_edges; out_edges; all_edges; apply_edges
      
      * in deg/out deg
      
      * subgraph/edge_subgraph
      
      * adj
      
      * in_subgraph/out_subgraph
      
      * sample neighbors
      
      * set/get_n/e_repr
      
      * wip: working on refactoring all idtypes
      
      * pass ndata/edata tests on gpu
      
      * fix
      
      * stash
      
      * workaround nonzero issue
      
      * stash
      
      * nx conversion
      
      * test_hetero_basics except update routines
      
      * test_update_routines
      
      * test_hetero_basics for pytorch
      
      * more fixes
      
      * WIP: flatten graph
      
      * wip: flatten
      
      * test_flatten
      
      * test_to_device
      
      * fix bug in to_homo
      
      * fix bug in CSRSliceMatrix
      
      * pass subgraph test
      
      * fix send_and_recv
      
      * fix filter
      
      * test_heterograph
      
      * passed all pytorch tests
      
      * fix mx unittest
      
      * fix pytorch test_nn
      
      * fix all unittests for PyTorch
      
      * passed all mxnet tests
      
      * lint
      
      * fix tf nn test
      
      * pass all tf tests
      
      * lint
      
      * lint
      
      * change deprecation
      
      * try fix compile
      
      * lint
      
      * update METIDS
      
      * fix utest
      
      * fix
      
      * fix utests
      
      * try debug
      
      * revert
      
      * small fix
      
      * fix utests
      
      * upd
      
      * upd
      
      * upd
      
      * fix
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * trigger
      
      * +1s
      
      * [kernel] Use heterograph index instead of unitgraph index (#1813)
      
      * upd
      
      * upd
      
      * upd
      
      * fix
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * trigger
      
      * +1s
      
      * [Graph] Mutation for Heterograph (#1818)
      
      * mutation add_nodes and add_edges
      
      * Add support for remove_edges, remove_nodes, add_selfloop, remove_selfloop
      
      * Fix
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-51-214.ec2.internal>
      
      * upd
      
      * upd
      
      * upd
      
      * fix
      
      * [Transfom] Mutable transform (#1833)
      
      * add nodesy
      
      * All three
      
      * Fix
      
      * lint
      
      * Add some test case
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Fix
      
      * fix
      
      * triger
      
      * Fix
      
      * fix
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-51-214.ec2.internal>
      
      * [Graph] Migrate Batch & Readout module to heterograph (#1836)
      
      * dgl.batch
      
      * unbatch
      
      * fix to device
      
      * reduce readout; segment reduce
      
      * change batch_num_nodes|edges to function
      
      * reduce readout/ softmax
      
      * broadcast
      
      * topk
      
      * fix
      
      * fix tf and mx
      
      * fix some ci
      
      * fix batch but unbatch differently
      
      * new checkk
      
      * upd
      
      * upd
      
      * upd
      
      * idtype behavior; code reorg
      
      * idtype behavior; code reorg
      
      * wip: test_basics
      
      * pass test_basics
      
      * WIP: from nx/ to nx
      
      * missing files
      
      * upd
      
      * pass test_basics:test_nx_conversion
      
      * Fix test
      
      * Fix inplace update
      
      * WIP: fixing tests
      
      * upd
      
      * pass test_transform cpu
      
      * pass gpu test_transform
      
      * pass test_batched_graph
      
      * GPU graph auto cast to int32
      
      * missing file
      
      * stash
      
      * WIP: rgcn-hetero
      
      * Fix two datasety
      
      * upd
      
      * weird
      
      * Fix capsuley
      
      * fuck you
      
      * fuck matthias
      
      * Fix dgmg
      
      * fix bug in block degrees; pass rgcn-hetero
      
      * rgcn
      
      * gat and diffpool fix
      also fix ppi and tu dataset
      
      * Tree LSTM
      
      * pointcloud
      
      * rrn; wip: sgc
      
      * resolve conflicts
      
      * upd
      
      * sgc and reddit dataset
      
      * upd
      
      * Fix deepwalk, gindt and gcn
      
      * fix datasets and sign
      
      * optimization
      
      * optimization
      
      * upd
      
      * upd
      
      * Fix GIN
      
      * fix bug in add_nodes add_edges; tagcn
      
      * adaptive sampling and gcmc
      
      * upd
      
      * upd
      
      * fix geometric
      
      * fix
      
      * metapath2vec
      
      * fix agnn
      
      * fix pickling problem of block
      
      * fix utests
      
      * miss file
      
      * linegraph
      
      * upd
      
      * upd
      
      * upd
      
      * graphsage
      
      * stgcn_wave
      
      * fix hgt
      
      * on unittests
      
      * Fix transformer
      
      * Fix HAN
      
      * passed pytorch unittests
      
      * lint
      
      * fix
      
      * Fix cluster gcn
      
      * cluster-gcn is ready
      
      * on fixing block related codes
      
      * 2nd order derivative
      
      * Revert "2nd order derivative"
      
      This reverts commit 523bf6c249bee61b51b1ad1babf42aad4167f206.
      
      * passed torch utests again
      
      * fix all mxnet unittests
      
      * delete some useless tests
      
      * pass all tf cpu tests
      
      * disable
      
      * disable distributed unittest
      
      * fix
      
      * fix
      
      * lint
      
      * fix
      
      * fix
      
      * fix script
      
      * fix tutorial
      
      * fix apply edges bug
      
      * fix 2 basics
      
      * fix tutorial
      Co-authored-by: default avataryzh119 <expye@outlook.com>
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-51-214.ec2.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-7-42.us-west-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-1-5.us-west-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-68-185.ec2.internal>
      44089c8b
  10. 18 Jul, 2020 1 commit
  11. 15 Jul, 2020 1 commit
  12. 10 Jul, 2020 1 commit
  13. 09 Jul, 2020 2 commits
  14. 05 Jul, 2020 1 commit
  15. 28 Jun, 2020 3 commits
  16. 22 Jun, 2020 2 commits
    • Zihao Ye's avatar
      [kernel] New SpMM & SDDMM kernel on CPU and CUDA (#1644) · 071cba1f
      Zihao Ye authored
      * udp
      
      * simplify
      
      * sddmm dot cpu
      
      * upd
      
      * format
      
      * upd
      
      * compatible with MJ's PR
      
      * lint
      
      * upd
      
      * upd
      
      * upd
      
      * python end
      
      * upd
      
      * upd
      
      * lint
      
      * lint
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * lint
      
      * fix mxnet
      
      * upd
      
      * lint
      
      * use minjie's ptr
      
      * macro
      
      * upd
      
      * reorg
      
      * lint
      
      * fix corner cases
      
      * upd
      
      * enrich cpu docs
      
      * upd
      
      * upd
      
      * lint
      
      * lint
      
      * pylint
      
      * sx review
      
      * improve docstring
      
      * python doc
      
      * upd
      
      * restructure
      
      * lint
      
      * upd test
      
      * upd
      
      * pylint
      
      * fix corner cases and test
      071cba1f
    • Jinjing Zhou's avatar
      fix byte array leak (#1679) · 90a103e7
      Jinjing Zhou authored
      
      Co-authored-by: default avatarChao Ma <mctt90@gmail.com>
      90a103e7
  17. 19 Jun, 2020 2 commits
  18. 18 Jun, 2020 1 commit
  19. 15 Jun, 2020 2 commits
    • Da Zheng's avatar
      [Feature] Range partition (#1522) · 41349dce
      Da Zheng authored
      
      
      * add reorder immutable graph.
      
      * add python API.
      
      * add reorder for csr.
      
      * remove gk version.
      
      * fix
      
      * add cpp test.
      
      * bug fixes
      
      * fix tests.
      
      * fix bugs and add check
      
      * fix test.
      
      * add omp.
      
      * add comments.
      
      * add coo reorder.
      
      * fix a bug.
      
      * handle reorder for different graph structues.
      
      * fix lint.
      
      * fix.
      
      * add original ids.
      
      * reshuffle nodes before metis partition.
      
      * inner nodes are in contiguous Id range.
      
      * reshuffle nodes/edges when partitioning.
      
      * load partition return graph partition book.
      
      * use inner_node/inner_edges
      
      * add and test range partition book.
      
      * count inner_edge correctly.
      
      * fix lint.
      
      * fix lint.
      
      * fix lint.
      
      * fix errors.
      
      * fix errors.
      
      * fix for TF.
      
      * fix.
      
      * fix.
      
      * change docstring.
      
      * support logical and.
      
      * add comments.
      
      * avoid copy.
      
      * fix
      
      * update docstring.
      
      * fix a bug.
      
      * add range search.
      
      * fix
      
      * fix a bug.
      
      * add more tests.
      
      * load graph partition book.
      
      * support shared memory for range partition book.
      
      * fix a bug.
      
      * fix.
      
      * fix lint.
      
      * remove check
      
      * fix test.
      
      * remove num_nodes and num_edges
      
      * fix lint.
      
      * fix graph partition book.
      
      * address comments.
      
      * use makedirs.
      
      * fix compile
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      Co-authored-by: default avatarChao Ma <mctt90@gmail.com>
      41349dce
    • Minjie Wang's avatar
      [Kernel] CUDA CSR2COO COOSort COO2CSR (#1620) · d6d517bb
      Minjie Wang authored
      
      
      * add cuda source
      
      * moving codes from kernel2 branch
      
      * operator overloading
      
      * Better error message for unsupported device
      
      * fix c tests
      
      * coo sort using cusparse
      
      * move test_rpc to distributed
      
      * lint
      
      * address comments and add utests
      Co-authored-by: default avatarJinjing Zhou <VoVAllen@users.noreply.github.com>
      Co-authored-by: default avatarChao Ma <mctt90@gmail.com>
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      d6d517bb
  20. 26 May, 2020 1 commit
    • Jinjing Zhou's avatar
      [Fix] New StreamWithBuffer interface (#1557) · 7639b5e7
      Jinjing Zhou authored
      
      
      * WIP: rpc components
      
      * client & server
      
      * move network package to rpc
      
      * fix include
      
      * fix compile
      
      * c api
      
      * wip: test
      
      * add basic tests
      
      * missing file
      
      * [RPC] Zero copy serializer (#1517)
      
      * zerocopy serialization
      
      * add test for HeteroGraph
      
      * fix lint
      
      * remove unnecessary codes
      
      * add comment
      
      * lint
      
      * lint
      
      * disable pylint for now
      
      * add include for win
      
      * windows guard
      
      * lint
      
      * lint
      
      * skip test on windows
      
      * refactor
      
      * add comment
      
      * fix
      
      * comment
      
      * 1111
      
      * fix
      
      * Update Jenkinsfile
      
      * [RPC] Implementation of RPC infra (#1544)
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * remove client.cc and server.cc
      
      * fix lint
      
      * update
      
      * update
      
      * fix linr
      
      * update
      
      * fix lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update test
      
      * update
      
      * update test
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update comment
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix lint
      
      * fix lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * Refactor StreamWithBuffer (#1550)
      
      * refactor
      
      * fix with new interface
      
      * remove copy
      
      * fix
      
      * remove comment
      Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
      Co-authored-by: default avatarChao Ma <mctt90@gmail.com>
      7639b5e7
  21. 22 May, 2020 1 commit
    • Chao Ma's avatar
      [RPC] New RPC infrastructure. (#1549) · 3e696922
      Chao Ma authored
      
      
      * WIP: rpc components
      
      * client & server
      
      * move network package to rpc
      
      * fix include
      
      * fix compile
      
      * c api
      
      * wip: test
      
      * add basic tests
      
      * missing file
      
      * [RPC] Zero copy serializer (#1517)
      
      * zerocopy serialization
      
      * add test for HeteroGraph
      
      * fix lint
      
      * remove unnecessary codes
      
      * add comment
      
      * lint
      
      * lint
      
      * disable pylint for now
      
      * add include for win
      
      * windows guard
      
      * lint
      
      * lint
      
      * skip test on windows
      
      * refactor
      
      * add comment
      
      * fix
      
      * comment
      
      * 1111
      
      * fix
      
      * Update Jenkinsfile
      
      * [RPC] Implementation of RPC infra (#1544)
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * remove client.cc and server.cc
      
      * fix lint
      
      * update
      
      * update
      
      * fix linr
      
      * update
      
      * fix lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update test
      
      * update
      
      * update test
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update comment
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix lint
      
      * fix lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
      Co-authored-by: default avatarJinjing Zhou <VoVAllen@users.noreply.github.com>
      3e696922
  22. 14 May, 2020 1 commit
  23. 08 May, 2020 1 commit
    • Jinjing Zhou's avatar
      [Refactor] Explicit dtype for HeteroGraph (#1467) · dc8ca88e
      Jinjing Zhou authored
      
      
      * 111
      
      * 111
      
      * lint
      
      * lint
      
      * lint
      
      * lint
      
      * fix
      
      * lint
      
      * try
      
      * fix
      
      * lint
      
      * lint
      
      * test
      
      * fix
      
      * ttt
      
      * test
      
      * fix
      
      * fix
      
      * fix
      
      * mxnet
      
      * 111
      
      * fix 64bits computation
      
      * pylint
      
      * roll back
      
      * fix
      
      * lint
      
      * fix hetero_from_relations
      
      * remove index_dtype in to_homo and to_hetero
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * remove default
      
      * fix
      
      * lint
      
      * fix
      
      * fix error message
      
      * fix error
      
      * lint
      
      * macro dispatch
      
      * try
      
      * lint
      
      * remove nbits
      
      * error message
      
      * fix
      
      * fix
      
      * lint
      
      * lint
      
      * lint
      
      * fix
      
      * lint
      
      * fix
      
      * fix random walk
      
      * lint
      
      * lint
      
      * fix
      
      * fix
      
      * fix
      
      * lint
      
      * fix
      
      * lint
      Co-authored-by: default avatarMinjie Wang <wmjlyjemaine@gmail.com>
      dc8ca88e
  24. 03 May, 2020 1 commit
    • Da Zheng's avatar
      [Feature] Distributed graph store (#1383) · 2190c39d
      Da Zheng authored
      * initial version from distributed training.
      
      This is copied from multiprocessing training.
      
      * modify for distributed training.
      
      * it's runnable now.
      
      * measure time in neighbor sampling.
      
      * simplify neighbor sampling.
      
      * fix a bug in distributed neighbor sampling.
      
      * allow single-machine training.
      
      * fix a bug.
      
      * fix a bug.
      
      * fix openmp.
      
      * make some improvement.
      
      * fix.
      
      * add prepare in the sampler.
      
      * prepare nodeflow async.
      
      * fix a bug.
      
      * get id.
      
      * simplify the code.
      
      * improve.
      
      * fix partition.py
      
      * fix the example.
      
      * add more features.
      
      * fix the example.
      
      * allow one partition
      
      * use distributed kvstore.
      
      * do g2l map manually.
      
      * fix commandline.
      
      * a temp script to save reddit.
      
      * fix pull_handler.
      
      * add pytorch version.
      
      * estimate the time for copying data.
      
      * delete unused code.
      
      * fix a bug.
      
      * print id.
      
      * fix a bug
      
      * fix a bug
      
      * fix a bug.
      
      * remove redundent code.
      
      * revert modify in sampler.
      
      * fix temp script.
      
      * remove pytorch version.
      
      * fix.
      
      * distributed training with pytorch.
      
      * add distributed graph store.
      
      * fix.
      
      * add metis_partition_assignment.
      
      * fix a few bugs in distributed graph store.
      
      * fix test.
      
      * fix bugs in distributed graph store.
      
      * fix tests.
      
      * remove code of defining DistGraphStore.
      
      * fix partition.
      
      * fix example.
      
      * update run.sh.
      
      * only read necessary node data.
      
      * batching data fetch of multiple NodeFlows.
      
      * simplify gcn.
      
      * remove unnecessary code.
      
      * use the new copy_from_kvstore.
      
      * update training script.
      
      * print time in graphsage.
      
      * make distributed training runnable.
      
      * use val_nid.
      
      * fix train_sampling.
      
      * add distributed training.
      
      * add run.sh
      
      * add more timing.
      
      * fix a bug.
      
      * save graph metadata when partition.
      
      * create ndata and edata in distributed graph store.
      
      * add timing in minibatch training of GraphSage.
      
      * use pytorch distributed.
      
      * add checks.
      
      * fix a bug in global vs. local ids.
      
      * remove fast pull
      
      * fix a compile error.
      
      * update and add new APIs.
      
      * implement more methods in DistGraphStore.
      
      * update more APIs.
      
      * rename it to DistGraph.
      
      * rename to DistTensor
      
      * remove some unnecessary API.
      
      * remove unnecessary files.
      
      * revert changes in sampler.
      
      * Revert "simplify gcn."
      
      This reverts commit 0ed3a34ca714203a5b45240af71555d4227ce452.
      
      * Revert "simplify neighbor sampling."
      
      This reverts commit 551c72d20f05a029360ba97f312c7a7a578aacec.
      
      * Revert "measure time in neighbor sampling."
      
      This reverts commit 63ae80c7b402bb626e24acbbc8fdfe9fffd0bc64.
      
      * Revert "add timing in minibatch training of GraphSage."
      
      This reverts commit e59dc8957a414c7df5c316f51d78bce822bdef5e.
      
      * Revert "fix train_sampling."
      
      This reverts commit ea6aea9a4aabb8ba0ff63070aa51e7ca81536ad9.
      
      * fix lint.
      
      * add comments and small update.
      
      * add more comments.
      
      * add more unit tests and fix bugs.
      
      * check the existence of shared-mem graph index.
      
      * use new partitioned graph storage.
      
      * fix bugs.
      
      * print error in fast pull.
      
      * fix lint
      
      * fix a compile error.
      
      * save absolute path after partitioning.
      
      * small fixes in the example
      
      * Revert "[kvstore] support any data type for init_data() (#1465)"
      
      This reverts commit 87b6997b
      
      .
      
      * fix a bug.
      
      * disable evaluation.
      
      * Revert "Revert "[kvstore] support any data type for init_data() (#1465)""
      
      This reverts commit f5b8039c6326eb73bad8287db3d30d93175e5bee.
      
      * support set and init data.
      
      * support set and init data.
      
      * Revert "Revert "[kvstore] support any data type for init_data() (#1465)""
      
      This reverts commit f5b8039c6326eb73bad8287db3d30d93175e5bee.
      
      * fix bugs.
      
      * fix unit test.
      
      * move to dgl.distributed.
      
      * fix lint.
      
      * fix lint.
      
      * remove local_nids.
      
      * fix lint.
      
      * fix test.
      
      * remove train_dist.
      
      * revert train_sampling.
      
      * rename funcs.
      
      * address comments.
      
      * address comments.
      
      Use NodeDataView/EdgeDataView to keep track of data.
      
      * address comments.
      
      * address comments.
      
      * revert.
      
      * save data with DGL serializer.
      
      * use the right way of getting shape.
      
      * fix lint.
      
      * address comments.
      
      * address comments.
      
      * fix an error in mxnet.
      
      * address comments.
      
      * add edge_map.
      
      * add more test and fix bugs.
      Co-authored-by: default avatarZheng <dzzhen@186590dc80ff.ant.amazon.com>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-6-131.us-east-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-26-167.us-east-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-16-150.us-west-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-16-250.us-west-2.compute.internal>
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-30-135.us-west-2.compute.internal>
      2190c39d
  25. 05 Apr, 2020 1 commit
  26. 30 Mar, 2020 2 commits
  27. 28 Mar, 2020 1 commit
  28. 27 Mar, 2020 1 commit
  29. 11 Mar, 2020 1 commit
    • Da Zheng's avatar
      [Feature] Improve the speed of to_bidirected (#1327) · 1a584ced
      Da Zheng authored
      * make graph symmetric
      
      * call gklib routine.
      
      * use gklib version except in windows.
      
      * minor errors.
      
      * fix test.
      
      * update doc.
      
      * fix a compile error.
      
      * fix.
      
      * add comments for the new C API.
      
      * fix a bug.
      
      * address comments.
      
      * fix compile error.
      
      * fix comment.
      1a584ced
  30. 08 Mar, 2020 1 commit
    • Da Zheng's avatar
      [Feature] add metis partitioning to DGL (#1308) · 0e153c4b
      Da Zheng authored
      
      
      * add metis.
      
      * add test.
      
      * construct partition id.
      
      * link to METIS github repo.
      
      * update metis.
      
      * add a tool for partitioning a graph.
      
      * update metis.
      
      * update.
      
      * update.
      
      * fix metis.
      
      * fix lint
      
      * fix indent.
      
      * another way of building metis.
      
      * disable metis in windows.
      
      * test windows
      
      * fix.
      
      * disable metis for windows properly.
      
      * fix for tensorflow.
      
      * skip test for gpu.
      
      * make graph symmetric
      
      * address comments.
      
      * more comments.
      
      * fix compile
      
      * fix a bug.
      
      * add test.
      
      * change the default #hops of HALO nodes.
      Co-authored-by: default avatarUbuntu <ubuntu@ip-172-31-26-167.us-east-2.compute.internal>
      0e153c4b
  31. 07 Mar, 2020 2 commits