Commits · 870da747eaee96313aa798806a22573ea1e1e8eb · OpenDAS / dgl

28 Jun, 2020 4 commits

[CUDA][Kernel] More CUDA kernels; Standardize the behavior for sorted COO/CSR (#1704) · 870da747

Minjie Wang authored Jun 28, 2020

* add cub; array cumsum

* CSRSliceRows

* fix warning

* operator << for ndarray; CSRSliceRows

* add CSRIsSorted

* add csr_sort

* inplace coosort and outplace csrsort

* WIP: coo is sorted

* mv cuda_utils

* add AllTrue utility

* csr sort

* coo sort

* coo2csr for sorted coo arrays

* CSRToCOO from sorted

* pass tests for the new kernel changes

* cannot use inplace sort

* lint

* try fix msvc error

* Fix g.copy_to and g.asnumbits; ToBlock no longer uses CSC

* stash

* revert some hack

* revert some changes

* address comments

* fix

* fix to_block unittest

* add todo note

870da747

fix parallel msbuild (#1717) · da8632ca
Quan (Andy) Gan authored Jun 28, 2020

da8632ca
fix knn graph bugs (#1716) · 2f983abe
Quan (Andy) Gan authored Jun 28, 2020

2f983abe

[Distributed] add constraints for metis partitioning. (#1708) · 04d4680d

Da Zheng authored Jun 27, 2020

* add constraint.

* fix bugs.

* temp fix.

* fix lint

* add balance_ntypes and balance_edges

* add comments.

* fix.

* fix

04d4680d

27 Jun, 2020 1 commit

[Distributed] Optimize distributed sampling (#1700) · 45e1333e

Da Zheng authored Jun 26, 2020



* optimize sampling neighbors from the local partition.

* fix minior bugs.

* fix lint

* overlap local sampling and remote sampling.

* fix.

* fix lint.

* fix a potential bug.
Co-authored-by: Chao Ma <mctt90@gmail.com>

45e1333e

26 Jun, 2020 2 commits

[BUGFIX] Fix bugs in range partitioning. (#1703) · 4b96addc

Da Zheng authored Jun 26, 2020

* Fix bugs in partitioning.

* add comment.

* fix lint.

* fix test.

* add more tests.

* simplify the fix

* fix.

4b96addc

[Feature]heterograph.edata and heterograph.ndata support multiple ntype and etype (#1673) · b742c559

xiang song(charlie.song) authored Jun 26, 2020



* g.edata and g.ndata support multiple ntype and etype

* Add test case

* support g.srcdata and g.dstdata

* Fix test

* lint

* Fix

* Fix some comments

* lint
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>

b742c559

24 Jun, 2020 2 commits

[BUGFIX] fix a bug in partition book. (#1698) · fa1478a4
Da Zheng authored Jun 24, 2020
```
* fix a bug.

* add msg for assert
```
fa1478a4

[NN] ChebConv update (#1460) · b6c4deb4

Axel Nilsson authored Jun 24, 2020



* New version for the convolutional layer

* Minor changes

* Minor changes

* Update python/dgl/nn/pytorch/conv/chebconv.py
Co-authored-by: Zihao Ye <zihaoye.cs@gmail.com>

* Resolved variable miss-naming, import simplifying and raising warning

* Added dg_warnings instead of warnings.warn

* add doc

* upd

* upd
Co-authored-by: Zihao Ye <zihaoye.cs@gmail.com>
Co-authored-by: yzh119 <expye@outlook.com>

b6c4deb4

23 Jun, 2020 2 commits
- Fix (#1684) · 86c243b4
  Mufei Li authored Jun 23, 2020
  
  86c243b4
- [Bugfix] Fix #1641 (#1678) · 421763fb
  Quan (Andy) Gan authored Jun 23, 2020
```
* fix #1641

* lint
```
  421763fb
22 Jun, 2020 1 commit

[kernel] New SpMM & SDDMM kernel on CPU and CUDA (#1644) · 071cba1f

Zihao Ye authored Jun 22, 2020

* udp

* simplify

* sddmm dot cpu

* upd

* format

* upd

* compatible with MJ's PR

* lint

* upd

* upd

* upd

* python end

* upd

* upd

* lint

* lint

* upd

* upd

* upd

* upd

* upd

* lint

* fix mxnet

* upd

* lint

* use minjie's ptr

* macro

* upd

* reorg

* lint

* fix corner cases

* upd

* enrich cpu docs

* upd

* upd

* lint

* lint

* pylint

* sx review

* improve docstring

* python doc

* upd

* restructure

* lint

* upd test

* upd

* pylint

* fix corner cases and test

071cba1f

21 Jun, 2020 2 commits

[Op] Farthest Point Sampler in Cpp and CUDA (#1630) · 3d47693b

Tong He authored Jun 22, 2020

* working framework without actual algorithm logic

* rename

* fix

* fps passes compilation

* correct algorithm

* add cuda implementation

* update random start

* before refactor

* pass compilation but cuda not working

* working

* code working, will add docstring

* add mxnet support

* update docstring

* update doc and test

* cpplint

* cpcplint

* pylint

* temporary fix

* fix for win64

* fix unitetest

* fix

* fix

* remove comment

* move to geometry package

* remove redundant include

* add docstrings and comments

* add proof

* add validity check

3d47693b

[RPC] Support null NDArray in RPC communication (#1653) · c8b18b79
Jinjing Zhou authored Jun 21, 2020

c8b18b79

19 Jun, 2020 2 commits

[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA (#1660) · f1b19a6b

Minjie Wang authored Jun 19, 2020

* add cuda utils; change g.to; add g.device

* split array.h into several headers

* cuda index select

* file

* three cuda kernels

* add cuda elementwise arith and several others

* cuda CSRIsNonZero

* fix lint

* lint

* lint

* fix bug in changing ctx to property

* address comments

* remove unused codes

* address comments

f1b19a6b

[Kernel] Migrate traversal on adjlist to CSR (#1650) · 42b0c38f

xiang song(charlie.song) authored Jun 19, 2020



* traversal to new framework

* add new

* Fix compile

* Pass test

* keep old version

* lint

* lint

* Fix

* Fix

* Fix compatability with new master

* Fix test and tutorials

* Update according to comments

* Fix test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

42b0c38f

18 Jun, 2020 4 commits

[RPC] Sampling over RPC (#1616) · fb248b67

Jinjing Zhou authored Jun 19, 2020



* fix

* test1111

* 111

* 111

* fff

* lint

* 111

* lint

* lint

* 111

* fijx

* 111

* fix

* 111

* commit

* 111

* 111

* lint

* fix typo

* fix

* lint

* fix

* 111

* support mxnet

* support mxnet

* lint

* remove print

* fix

* fix test.

* fix test.

* fix test.

* try to fix an undetermistic error.
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

fb248b67

[Distributed] support no shared memory. (#1663) · ff5b5a4a

Da Zheng authored Jun 18, 2020

* support no shared memory.

* add test.

* add CAPI to check existence of shared memory.

* revert the change in src/runtime/ndarray.cc

* update docstring.

* fix compile.

ff5b5a4a

[Optimization] Optimize pickling of heterograph (#1570) · 0a4e8b32

Qidong Su authored Jun 18, 2020



* update

* update

* update

* update

* update

* update

* backward compatibility

* update

* update

* update

* update

* update

* test

* test

* update

* update

* update

* update

* update

* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

0a4e8b32

[BUGFIX] reshuffle node features in range partitioning. (#1659) · b9ec3e36
Da Zheng authored Jun 17, 2020
```
* fix a bug.

* fix test.

* simplify.

* fix test.

* test edge features.

* fix.
```
b9ec3e36

17 Jun, 2020 1 commit

[KVStore] Add fast-pull for kvstore (#1647) · b372b3c7

Chao Ma authored Jun 17, 2020

* add fast-pull

* update

* add fast-pull

* update

* update

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* add omp

* update

* update

b372b3c7

16 Jun, 2020 1 commit
- [KVStore] make pull/push handler per tensor. (#1646) · e8a56dc1
  Da Zheng authored Jun 15, 2020
```
* make pull/push handler per tensor.

* update.
```
  e8a56dc1
15 Jun, 2020 4 commits

[Feature] Range partition (#1522) · 41349dce

Da Zheng authored Jun 15, 2020



* add reorder immutable graph.

* add python API.

* add reorder for csr.

* remove gk version.

* fix

* add cpp test.

* bug fixes

* fix tests.

* fix bugs and add check

* fix test.

* add omp.

* add comments.

* add coo reorder.

* fix a bug.

* handle reorder for different graph structues.

* fix lint.

* fix.

* add original ids.

* reshuffle nodes before metis partition.

* inner nodes are in contiguous Id range.

* reshuffle nodes/edges when partitioning.

* load partition return graph partition book.

* use inner_node/inner_edges

* add and test range partition book.

* count inner_edge correctly.

* fix lint.

* fix lint.

* fix lint.

* fix errors.

* fix errors.

* fix for TF.

* fix.

* fix.

* change docstring.

* support logical and.

* add comments.

* avoid copy.

* fix

* update docstring.

* fix a bug.

* add range search.

* fix

* fix a bug.

* add more tests.

* load graph partition book.

* support shared memory for range partition book.

* fix a bug.

* fix.

* fix lint.

* remove check

* fix test.

* remove num_nodes and num_edges

* fix lint.

* fix graph partition book.

* address comments.

* use makedirs.

* fix compile
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>

41349dce

[Bug?] Fix #1563 (#1642) · 3e72c53a
Quan (Andy) Gan authored Jun 15, 2020

3e72c53a

[Kernel] CUDA CSR2COO COOSort COO2CSR (#1620) · d6d517bb

Minjie Wang authored Jun 15, 2020



* add cuda source

* moving codes from kernel2 branch

* operator overloading

* Better error message for unsupported device

* fix c tests

* coo sort using cusparse

* move test_rpc to distributed

* lint

* address comments and add utests
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

d6d517bb

[NN] Add low memory support for nn.RelGraphConv (#1631) · 61f007c4

xiang song(charlie.song) authored Jun 15, 2020



* Add low memory support for relgraphconv
y

* lint

* Add tf support

* Fix lint

* Fix mxnet

* Fix mxnet

* Fix

* minor fix

* Fix
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

61f007c4

11 Jun, 2020 5 commits

[HeteroGraph] Improve Error Messages for find_edges (#1626) · fe207b45

Mufei Li authored Jun 11, 2020



* Improve error message

* Fix

* Fix
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

fe207b45

[CI] Use spawn in unittest instead of fork (#1627) · 77006db2

Jinjing Zhou authored Jun 11, 2020



* update

* update

* update

* update

* update

* update

* fix ci using spawn
Co-authored-by: aksnzhy <mctt90@gmail.com>

77006db2

[rpc] Move test_rpc.py to distributed and use dynamic port binding (#1623) · 0c313e51
Chao Ma authored Jun 11, 2020
```
* update

* update

* update

* update

* update

* update

* update

* update
```
0c313e51
[RPC] Add send_request_to_machine() and remote_call_to_machine() (#1619) · a67ba946
Chao Ma authored Jun 11, 2020
```
* add send_request_to_machine()

* update

* update

* update

* update

* update

* update

* fix lint

* update
```
a67ba946

Refactor distributed graph store (#1597) · 50962c43

Da Zheng authored Jun 10, 2020

* refactor graph store for new kvstore.

* fix kvstore.

* fix.

* fix lint complains.

* add docstring.

* small fix in graph partition book.

* fix.

* remove tests

* disable sampling.

* Revert "disable sampling."

This reverts commit 70451008f61ff1481d5dadbf8bd199470aee559d.

* Revert "remove tests"

This reverts commit 1394364243bdd73b669abde6193a74e2cda5521d.

50962c43

09 Jun, 2020 1 commit
- [KVStore] Update kvstore test (#1607) · 48cc8fa8
  Chao Ma authored Jun 09, 2020
```
* remove freeze

* update

* update

* fix lint

* update test

* update
```
  48cc8fa8
04 Jun, 2020 1 commit

[KVStore] Re-write kvstore using DGL RPC infrastructure (#1569) · 64f49703

Chao Ma authored Jun 04, 2020

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update init_data

* update server_state

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* debug init_data

* update

* update

* update

* update

* update

* update

* test get_meta_data

* update

* update

* update

* update

* update

* debug push

* update

* update

* update

* update

* update

* update

* update

* update

* update

* use F.reverse_data_type_dict

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* fix lint

* update

* fix lint

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* set random seed

* update

64f49703

02 Jun, 2020 1 commit
- [Hetero] Allow Batching Graphs with Zero Nodes/Edges (#1575) · a936f9d9
  Mufei Li authored Jun 02, 2020
```
* Allow batching graphs with zero nodes and edges

* Fix the case without node/edge features

* Fix lint
```
  a936f9d9
28 May, 2020 1 commit

[Test] add regression tests for graph partitioning. (#1561) · b9e4a5b7

Da Zheng authored May 28, 2020



* add tests.

* 111

* fix

* Update asv.conf.json

* fix.

* benchmark partition with livejournal.

* fix benchmark

* fix.

* fix.

* remove ogb

* Revert "Update asv.conf.json"

This reverts commit dd327a5564f4ef01795e444e79b17265b9c8b391.

* change branch

* depend pandas

* Revert "change branch"

This reverts commit 1d4f93756492a93f2e3cde07229a59a31a8c380b.

* Update README.md
Co-authored-by: VoVAllen <jz1749@nyu.edu>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

b9e4a5b7

26 May, 2020 1 commit

[Fix] New StreamWithBuffer interface (#1557) · 7639b5e7

Jinjing Zhou authored May 27, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Refactor StreamWithBuffer (#1550)

* refactor

* fix with new interface

* remove copy

* fix

* remove comment
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>

7639b5e7

22 May, 2020 1 commit

[RPC] New RPC infrastructure. (#1549) · 3e696922

Chao Ma authored May 22, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

3e696922

15 May, 2020 1 commit
- [Feature] Add a request_format api and enrich related docstring. (#1528) · 70dc2ee9
  Zihao Ye authored May 16, 2020
```
* upd

* upd

* lint

* fix

* bloody lint
```
  70dc2ee9
14 May, 2020 2 commits

[Feature] Split data for distributed training (#1505) · 96984fac

Da Zheng authored May 14, 2020



* fix tests in graph partition book.

* implement node_split and edge_split.

* fix a bug.

* add tests.

* remove unnecessary code.

* avoid storing graph structure in partition book.

* add partition book in DistGraph.

* Revert "avoid storing graph structure in partition book."

This reverts commit 55b11fbf9293efcae5f8c97e93f1e121399dadae.

* small fixes.

* add a test for boolean mask vector.

* fix test.

* fix bugs.

* make it work for all different cases.

* fix tests.

* fix boolean mask

* fix for TF

* fix for tensorflow.

* fix test for TF

* only support boolean mask for now.

* fix tests.

* make the code more readable.

* fix test.
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

96984fac

[hotfix] Several bug fix for remove nodes/edges in DGLGraph. (#1521) · cfb24790
Zihao Ye authored May 15, 2020
```
* upd

* upd

* better
```
cfb24790