Commits · 168a88e57070871eef5a9fcdad3ed1a4d708d7bd · OpenDAS / dgl

02 Jul, 2020 1 commit

[Sampling] NodeDataLoader for node classification (#1635) · 168a88e5

Quan (Andy) Gan authored Jul 02, 2020



* neighbor sampler data loader first commit

* more commit

* nodedataloader

* fix

* update RGCN example

* update OGB

* fixes

* fix minibatch RGCN crashing with self loop

* reverting gatconv test code

* fix

* change to new solution that doesn't require tf dataloader

* fix

* lint

* fix

* fixes

* change doc

* fix docstring

* docstring fixes

* return seeds and input nodes from data loader

* fixes

* fix test

* fix windows build problem

* add pytorch wrapper

* fixes

* add pytorch wrapper

* add unit test

* add -1 support to sample_neighbors & fix docstrings

* docstring fix

* lint

* add minibatch rgcn evaluations
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Tong He <hetong007@gmail.com>

168a88e5

30 Jun, 2020 1 commit

[Data] Support HeteroGraph save/load (#1526) · 18a26fcf

Jinjing Zhou authored Jun 30, 2020



* 111

* add history version test

* fix

* 111

* save

* ``

* fix1

* 111

* add save heterograph

* lint

* lint

* add tests

* minor fix

* fix

* docs

* add format tets

* use unique_ptr

* fix

* fix interface

* 111

* 111

* fix

* lint

* fix

* add support to s3

* fix

* fix

* fix leak

* fix

* fix docs

* fix

* linlt

* fix

* fix

* fix

* address comment

* address comment
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

18a26fcf

28 Jun, 2020 5 commits

[DGLHeteroGraph] Add unittest for srcdst Order for DGLHeteroGraph.all_edges (#1677) · 0015eff7

Mufei Li authored Jun 29, 2020



* Fix (#1)

* Update

* Fix

* Fix

* Update

* Fix

* Fix

* Fix

* Fix

* Fixg

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Add test case

* Trigger CI (#2)

* Update

* Fix

* Fix

* Update

* Fix

* Fix

* Fix

* Fix

* Fixg

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Add test case

* test

* Fix (#3)

* Update

* Fix

* Fix

* Update

* Fix

* Fix

* Fix

* Fix

* Fixg

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Fix

* Add test case

* test

* Fix

* Fix

* Roll back

* Roll back

* CI
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>

0015eff7

[Kernel] Migrate batching/unbatching on adjlist to CSR/COO (#1687) · 5747542f

xiang song(charlie.song) authored Jun 28, 2020



* start

* coo csr union partition

* lint

* lint

* lint

* Add matrix->data transform

* update

* Fix window compile

* Add CSR support for DisjointPartition

* lint

* Fix

* Use IdArray Op

* Concat ready

* Fix and all pass

* resolve comments

* Add union COO C++ test

* Add C++ test for csr

* lint

* triger

* Update include

* Fix merge

* test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

5747542f

[Feature] dgl.subgraph support Bool mask tensor as index. (#1709) · 55072b4e

xiang song(charlie.song) authored Jun 28, 2020



* dgl.subgraph support using Bool mask tensor

* support numpy boo tensor and add some test

* Update

* Fix docstring
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

55072b4e

[CUDA][Kernel] More CUDA kernels; Standardize the behavior for sorted COO/CSR (#1704) · 870da747

Minjie Wang authored Jun 28, 2020

* add cub; array cumsum

* CSRSliceRows

* fix warning

* operator << for ndarray; CSRSliceRows

* add CSRIsSorted

* add csr_sort

* inplace coosort and outplace csrsort

* WIP: coo is sorted

* mv cuda_utils

* add AllTrue utility

* csr sort

* coo sort

* coo2csr for sorted coo arrays

* CSRToCOO from sorted

* pass tests for the new kernel changes

* cannot use inplace sort

* lint

* try fix msvc error

* Fix g.copy_to and g.asnumbits; ToBlock no longer uses CSC

* stash

* revert some hack

* revert some changes

* address comments

* fix

* fix to_block unittest

* add todo note

870da747

[Distributed] add constraints for metis partitioning. (#1708) · 04d4680d

Da Zheng authored Jun 27, 2020

* add constraint.

* fix bugs.

* temp fix.

* fix lint

* add balance_ntypes and balance_edges

* add comments.

* fix.

* fix

04d4680d

26 Jun, 2020 2 commits

[BUGFIX] Fix bugs in range partitioning. (#1703) · 4b96addc

Da Zheng authored Jun 26, 2020

* Fix bugs in partitioning.

* add comment.

* fix lint.

* fix test.

* add more tests.

* simplify the fix

* fix.

4b96addc

[Feature]heterograph.edata and heterograph.ndata support multiple ntype and etype (#1673) · b742c559

xiang song(charlie.song) authored Jun 26, 2020



* g.edata and g.ndata support multiple ntype and etype

* Add test case

* support g.srcdata and g.dstdata

* Fix test

* lint

* Fix

* Fix some comments

* lint
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>
Co-authored-by: Mufei Li <mufeili1996@gmail.com>

b742c559

23 Jun, 2020 2 commits
- Fix (#1684) · 86c243b4
  Mufei Li authored Jun 23, 2020
  
  86c243b4
- [Bugfix] Fix #1641 (#1678) · 421763fb
  Quan (Andy) Gan authored Jun 23, 2020
```
* fix #1641

* lint
```
  421763fb
22 Jun, 2020 1 commit

[kernel] New SpMM & SDDMM kernel on CPU and CUDA (#1644) · 071cba1f

Zihao Ye authored Jun 22, 2020

* udp

* simplify

* sddmm dot cpu

* upd

* format

* upd

* compatible with MJ's PR

* lint

* upd

* upd

* upd

* python end

* upd

* upd

* lint

* lint

* upd

* upd

* upd

* upd

* upd

* lint

* fix mxnet

* upd

* lint

* use minjie's ptr

* macro

* upd

* reorg

* lint

* fix corner cases

* upd

* enrich cpu docs

* upd

* upd

* lint

* lint

* pylint

* sx review

* improve docstring

* python doc

* upd

* restructure

* lint

* upd test

* upd

* pylint

* fix corner cases and test

071cba1f

19 Jun, 2020 2 commits

[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA (#1660) · f1b19a6b

Minjie Wang authored Jun 19, 2020

* add cuda utils; change g.to; add g.device

* split array.h into several headers

* cuda index select

* file

* three cuda kernels

* add cuda elementwise arith and several others

* cuda CSRIsNonZero

* fix lint

* lint

* lint

* fix bug in changing ctx to property

* address comments

* remove unused codes

* address comments

f1b19a6b

[Kernel] Migrate traversal on adjlist to CSR (#1650) · 42b0c38f

xiang song(charlie.song) authored Jun 19, 2020



* traversal to new framework

* add new

* Fix compile

* Pass test

* keep old version

* lint

* lint

* Fix

* Fix

* Fix compatability with new master

* Fix test and tutorials

* Update according to comments

* Fix test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

42b0c38f

18 Jun, 2020 1 commit

[Optimization] Optimize pickling of heterograph (#1570) · 0a4e8b32

Qidong Su authored Jun 18, 2020



* update

* update

* update

* update

* update

* update

* backward compatibility

* update

* update

* update

* update

* update

* test

* test

* update

* update

* update

* update

* update

* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

0a4e8b32

15 Jun, 2020 2 commits

[Feature] Range partition (#1522) · 41349dce

Da Zheng authored Jun 15, 2020



* add reorder immutable graph.

* add python API.

* add reorder for csr.

* remove gk version.

* fix

* add cpp test.

* bug fixes

* fix tests.

* fix bugs and add check

* fix test.

* add omp.

* add comments.

* add coo reorder.

* fix a bug.

* handle reorder for different graph structues.

* fix lint.

* fix.

* add original ids.

* reshuffle nodes before metis partition.

* inner nodes are in contiguous Id range.

* reshuffle nodes/edges when partitioning.

* load partition return graph partition book.

* use inner_node/inner_edges

* add and test range partition book.

* count inner_edge correctly.

* fix lint.

* fix lint.

* fix lint.

* fix errors.

* fix errors.

* fix for TF.

* fix.

* fix.

* change docstring.

* support logical and.

* add comments.

* avoid copy.

* fix

* update docstring.

* fix a bug.

* add range search.

* fix

* fix a bug.

* add more tests.

* load graph partition book.

* support shared memory for range partition book.

* fix a bug.

* fix.

* fix lint.

* remove check

* fix test.

* remove num_nodes and num_edges

* fix lint.

* fix graph partition book.

* address comments.

* use makedirs.

* fix compile
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>

41349dce

[Bug?] Fix #1563 (#1642) · 3e72c53a
Quan (Andy) Gan authored Jun 15, 2020

3e72c53a

11 Jun, 2020 3 commits
- [HeteroGraph] Improve Error Messages for find_edges (#1626) · fe207b45
  Mufei Li authored Jun 11, 2020
```
* Improve error message

* Fix

* Fix
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
```
  fe207b45
- [rpc] Move test_rpc.py to distributed and use dynamic port binding (#1623) · 0c313e51
  Chao Ma authored Jun 11, 2020
```
* update

* update

* update

* update

* update

* update

* update

* update
```
  0c313e51
- [RPC] Add send_request_to_machine() and remote_call_to_machine() (#1619) · a67ba946
  Chao Ma authored Jun 11, 2020
```
* add send_request_to_machine()

* update

* update

* update

* update

* update

* update

* fix lint

* update
```
  a67ba946
04 Jun, 2020 1 commit

[KVStore] Re-write kvstore using DGL RPC infrastructure (#1569) · 64f49703

Chao Ma authored Jun 04, 2020

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update init_data

* update server_state

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* debug init_data

* update

* update

* update

* update

* update

* update

* test get_meta_data

* update

* update

* update

* update

* update

* debug push

* update

* update

* update

* update

* update

* update

* update

* update

* update

* use F.reverse_data_type_dict

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* fix lint

* update

* fix lint

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* set random seed

* update

64f49703

02 Jun, 2020 1 commit
- [Hetero] Allow Batching Graphs with Zero Nodes/Edges (#1575) · a936f9d9
  Mufei Li authored Jun 02, 2020
```
* Allow batching graphs with zero nodes and edges

* Fix the case without node/edge features

* Fix lint
```
  a936f9d9
22 May, 2020 1 commit

[RPC] New RPC infrastructure. (#1549) · 3e696922

Chao Ma authored May 22, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

3e696922

15 May, 2020 1 commit
- [Feature] Add a request_format api and enrich related docstring. (#1528) · 70dc2ee9
  Zihao Ye authored May 16, 2020
```
* upd

* upd

* lint

* fix

* bloody lint
```
  70dc2ee9
14 May, 2020 2 commits

[hotfix] Several bug fix for remove nodes/edges in DGLGraph. (#1521) · cfb24790
Zihao Ye authored May 15, 2020
```
* upd

* upd

* better
```
cfb24790

[Refactor] Restrict sparse format for DGLHeteroGraph (#1474) · c2e61ce1

Zihao Ye authored May 14, 2020



* upd

* simplify

* further simplify

* lint

* doc

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* lint

* rename format

* upd

* lint

* upd

* upd

* upd

* udp

* debug

* upd

* upd

* upd

* upd

* upd

* 无可厚非吧

* 中三边肥

* 你一定要喊吗

* lint

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* Update unit_graph.h
Co-authored-by: Zihao Ye <yzh119@192.168.0.110>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

c2e61ce1

08 May, 2020 2 commits

[bugfix] Fix the behavior of dgl.batch when batch size is 1 (#1483) · 1af0d806
Zihao Ye authored May 08, 2020
```
* fix

* upd

* upd

* upd

* upd

* clone

* upd
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
```
1af0d806

[Refactor] Explicit dtype for HeteroGraph (#1467) · dc8ca88e

Jinjing Zhou authored May 08, 2020



* 111

* 111

* lint

* lint

* lint

* lint

* fix

* lint

* try

* fix

* lint

* lint

* test

* fix

* ttt

* test

* fix

* fix

* fix

* mxnet

* 111

* fix 64bits computation

* pylint

* roll back

* fix

* lint

* fix hetero_from_relations

* remove index_dtype in to_homo and to_hetero

* fix

* fix

* fix

* fix

* remove default

* fix

* lint

* fix

* fix error message

* fix error

* lint

* macro dispatch

* try

* lint

* remove nbits

* error message

* fix

* fix

* lint

* lint

* lint

* fix

* lint

* fix

* fix random walk

* lint

* lint

* fix

* fix

* fix

* lint

* fix

* lint
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>

dc8ca88e

02 May, 2020 2 commits

[KVStore] Fix bug of get_meta() API (#1491) · 5fc334fc

Chao Ma authored May 02, 2020

* fix get-shape

* update

* update

* update

* update

* update

* fix typo

* update

* update

5fc334fc

[Fix] Fix stream creation and empty dict in tensor serialization (#1489) · 30b8074a

Jinjing Zhou authored May 02, 2020

* add functions

* fix litn

* add unit test

* fix

* fix

* fix

* fix

* support empty dict

* simplify logic

* Update tensor_serialize.py

30b8074a

01 May, 2020 1 commit

[Hetero] Improve speed of several Hetero APIs (#1486) · f25bc176

Minjie Wang authored May 01, 2020

* add clone function to frame

* add utest

* replace all local_var with local_scope

* fix utest

* avoid creating canonical types in __getitem__

* lint

* try another utest  appraoch for mx

* utest

f25bc176

29 Apr, 2020 1 commit
- [Bugfix] Add bool data type to backend. (#1487) · 3c4506e9
  Minjie Wang authored Apr 29, 2020
```
* add bool to F.data_type_dict

* add utest

* skip bool test for mx
```
  3c4506e9
27 Apr, 2020 2 commits

[Data] Add utils to save dict of tensors (#1481) · 1506560e
Jinjing Zhou authored Apr 28, 2020
```
* add functions

* fix litn

* add unit test

* fix

* fix
```
1506560e

[KVStore] Bug fix (#1480) · 100ddd06

Chao Ma authored Apr 28, 2020



* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* Update network.cc
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

100ddd06

26 Apr, 2020 1 commit

[KVStore] add init_data() on client (#1466) · 27520bc5

Chao Ma authored Apr 26, 2020

* add init_data on client

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

27520bc5

20 Apr, 2020 1 commit

[KVstore] Improve user infterface (#1454) · 5efd1c4a

Chao Ma authored Apr 21, 2020

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

5efd1c4a

09 Apr, 2020 1 commit
- [Bug] Fix khop graph (#1433) · bd1e48a5
  Mufei Li authored Apr 10, 2020
```
* Update

* Update

* Update
```
  bd1e48a5
06 Apr, 2020 1 commit
- fix #1421 (#1422) · 91f7ff8e
  Quan (Andy) Gan authored Apr 06, 2020
  
  91f7ff8e
05 Apr, 2020 1 commit

[Feature] Simplify shared memory graph index (#1381) · 7c47d8c9

Da Zheng authored Apr 05, 2020



* simplify shared memory graph index.

* fix.

* remove edge_dir in SharedMemGraphStore.

* avoid creating shared-mem graph store with from_csr.

* simplify from_csr.

* add comments.

* fix lint.

* remove the test.

* fix compilation error.

* fix a bug.

* fix a bug.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-150.us-west-2.compute.internal>

7c47d8c9

03 Apr, 2020 1 commit
- [BUG] Fix #1409 (#1411) · 24dc71fc
  Quan (Andy) Gan authored Apr 03, 2020
```
* [BUG] Fix #1409

* fix test
```
  24dc71fc