Commits · bdc1e649e0f548c97355db1afa66e6a4aa2a132a · OpenDAS / dgl

07 Jul, 2020 1 commit
- [RPC] Client will retry connection until the server starts. (#1758) · bdc1e649
  Chao Ma authored Jul 07, 2020
```
* update

* update

* update
```
  bdc1e649
05 Jul, 2020 1 commit

[Aten] Add nonzero op (#1746) · 9cd0d3f8

Jinjing Zhou authored Jul 05, 2020



* add nonzero op

* 111

* fix doc
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

9cd0d3f8

04 Jul, 2020 1 commit

[Kernel]GraphOp::Reverse (#1730) · feabcabd

xiang song(charlie.song) authored Jul 04, 2020



* Compile OK

* Fix compile

* Explore reverse to heterograph_indx and add python test code

* lint

* Fix some bug

* Fix bug

* upd

* Fix

* fix lint

* Fix

* Fix

* test

* triger

* Fix

* upd

* add TODO

* upd
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>
Co-authored-by: Zihao Ye <expye@outlook.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

feabcabd

03 Jul, 2020 1 commit

Use timeval to set up SO_RCVTIMEO (#1734) · f80fc9bd

mszarma authored Jul 03, 2020



Refactor code to use timeval struct
for setting up the SO_RCVTIMEO variable
timeout value for sockets in case of Linux.
Changed SetTimeout API timeout input to seconds.
Co-authored-by: Chao Ma <mctt90@gmail.com>

f80fc9bd

02 Jul, 2020 1 commit

[Sampling] NodeDataLoader for node classification (#1635) · 168a88e5

Quan (Andy) Gan authored Jul 02, 2020



* neighbor sampler data loader first commit

* more commit

* nodedataloader

* fix

* update RGCN example

* update OGB

* fixes

* fix minibatch RGCN crashing with self loop

* reverting gatconv test code

* fix

* change to new solution that doesn't require tf dataloader

* fix

* lint

* fix

* fixes

* change doc

* fix docstring

* docstring fixes

* return seeds and input nodes from data loader

* fixes

* fix test

* fix windows build problem

* add pytorch wrapper

* fixes

* add pytorch wrapper

* add unit test

* add -1 support to sample_neighbors & fix docstrings

* docstring fix

* lint

* add minibatch rgcn evaluations
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Tong He <hetong007@gmail.com>

168a88e5

30 Jun, 2020 2 commits

[Kernel] Use omp flush in CSRIsSorted (#1725) · b1e83b6e

xiang song(charlie.song) authored Jun 30, 2020



* Use omp flush

* test

* test

* remove omp
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

b1e83b6e

[Data] Support HeteroGraph save/load (#1526) · 18a26fcf

Jinjing Zhou authored Jun 30, 2020



* 111

* add history version test

* fix

* 111

* save

* ``

* fix1

* 111

* add save heterograph

* lint

* lint

* add tests

* minor fix

* fix

* docs

* add format tets

* use unique_ptr

* fix

* fix interface

* 111

* 111

* fix

* lint

* fix

* add support to s3

* fix

* fix

* fix leak

* fix

* fix docs

* fix

* linlt

* fix

* fix

* fix

* address comment

* address comment
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

18a26fcf

29 Jun, 2020 1 commit

[rpc] Add num_clients and sort client ID by machine-id (#1713) · dd8d5289

Chao Ma authored Jun 29, 2020



* add num_clients to kvstore

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* update

* update

* add test

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

dd8d5289

28 Jun, 2020 4 commits

[Kernel] Migrate batching/unbatching on adjlist to CSR/COO (#1687) · 5747542f

xiang song(charlie.song) authored Jun 28, 2020



* start

* coo csr union partition

* lint

* lint

* lint

* Add matrix->data transform

* update

* Fix window compile

* Add CSR support for DisjointPartition

* lint

* Fix

* Use IdArray Op

* Concat ready

* Fix and all pass

* resolve comments

* Add union COO C++ test

* Add C++ test for csr

* lint

* triger

* Update include

* Fix merge

* test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

5747542f

[CUDA][Kernel] More CUDA kernels; Standardize the behavior for sorted COO/CSR (#1704) · 870da747

Minjie Wang authored Jun 28, 2020

* add cub; array cumsum

* CSRSliceRows

* fix warning

* operator << for ndarray; CSRSliceRows

* add CSRIsSorted

* add csr_sort

* inplace coosort and outplace csrsort

* WIP: coo is sorted

* mv cuda_utils

* add AllTrue utility

* csr sort

* coo sort

* coo2csr for sorted coo arrays

* CSRToCOO from sorted

* pass tests for the new kernel changes

* cannot use inplace sort

* lint

* try fix msvc error

* Fix g.copy_to and g.asnumbits; ToBlock no longer uses CSC

* stash

* revert some hack

* revert some changes

* address comments

* fix

* fix to_block unittest

* add todo note

870da747

[Bug] Fix #1712 (#1714) · 8b539079
Quan (Andy) Gan authored Jun 28, 2020
```
* fix debug compilation

* fix

* revert
```
8b539079

[Distributed] add constraints for metis partitioning. (#1708) · 04d4680d

Da Zheng authored Jun 27, 2020

* add constraint.

* fix bugs.

* temp fix.

* fix lint

* add balance_ntypes and balance_edges

* add comments.

* fix.

* fix

04d4680d

23 Jun, 2020 1 commit
- [Bugfix] Fix #1641 (#1678) · 421763fb
  Quan (Andy) Gan authored Jun 23, 2020
```
* fix #1641

* lint
```
  421763fb
22 Jun, 2020 2 commits

[kernel] New SpMM & SDDMM kernel on CPU and CUDA (#1644) · 071cba1f

Zihao Ye authored Jun 22, 2020

* udp

* simplify

* sddmm dot cpu

* upd

* format

* upd

* compatible with MJ's PR

* lint

* upd

* upd

* upd

* python end

* upd

* upd

* lint

* lint

* upd

* upd

* upd

* upd

* upd

* lint

* fix mxnet

* upd

* lint

* use minjie's ptr

* macro

* upd

* reorg

* lint

* fix corner cases

* upd

* enrich cpu docs

* upd

* upd

* lint

* lint

* pylint

* sx review

* improve docstring

* python doc

* upd

* restructure

* lint

* upd test

* upd

* pylint

* fix corner cases and test

071cba1f

[Model] PointNet and PointNet++ for point cloud (#1510) · 558673e1

Tong He authored Jun 22, 2020



* commit patch

* commit patch

* pointnet basic

* fix data

* reorg

* reorg

* temp status

* remove validate set

* add partseg data and model

* partseg miou

* clean up

* fix loss

* network definition match paper

* fix

* fix miou

* update data format

* fix

* fix

* working pointnet ssg cls

* avoid some pytorch bug

* fix script

* update hyperparams

* add msg module

* try different dataset

* update new dataset info

* quick fix to subgraph

* fix speed

* update training

* update

* fix bs

* update docstring

* update

* update

* remove parallel reduction in fps

* switch to kernel fps, training is 30% faster
Co-authored-by: Ubuntu <ubuntu@ip-172-31-20-181.us-west-2.compute.internal>

558673e1

21 Jun, 2020 3 commits

[Optimization] Replaced std::unordered_map by phmap::flat_hash_map (#1662) · 8a20b6c1
IzabelaMazur authored Jun 21, 2020
```
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
```
8a20b6c1

[Op] Farthest Point Sampler in Cpp and CUDA (#1630) · 3d47693b

Tong He authored Jun 22, 2020

* working framework without actual algorithm logic

* rename

* fix

* fps passes compilation

* correct algorithm

* add cuda implementation

* update random start

* before refactor

* pass compilation but cuda not working

* working

* code working, will add docstring

* add mxnet support

* update docstring

* update doc and test

* cpplint

* cpcplint

* pylint

* temporary fix

* fix for win64

* fix unitetest

* fix

* fix

* remove comment

* move to geometry package

* remove redundant include

* add docstrings and comments

* add proof

* add validity check

3d47693b

[RPC] Support null NDArray in RPC communication (#1653) · c8b18b79
Jinjing Zhou authored Jun 21, 2020

c8b18b79

19 Jun, 2020 2 commits

[CUDA] Many CUDA operators; Prepare for DGLGraph on CUDA (#1660) · f1b19a6b

Minjie Wang authored Jun 19, 2020

* add cuda utils; change g.to; add g.device

* split array.h into several headers

* cuda index select

* file

* three cuda kernels

* add cuda elementwise arith and several others

* cuda CSRIsNonZero

* fix lint

* lint

* lint

* fix bug in changing ctx to property

* address comments

* remove unused codes

* address comments

f1b19a6b

[Kernel] Migrate traversal on adjlist to CSR (#1650) · 42b0c38f

xiang song(charlie.song) authored Jun 19, 2020



* traversal to new framework

* add new

* Fix compile

* Pass test

* keep old version

* lint

* lint

* Fix

* Fix

* Fix compatability with new master

* Fix test and tutorials

* Update according to comments

* Fix test
Co-authored-by: Ubuntu <ubuntu@ip-172-31-51-214.ec2.internal>

42b0c38f

18 Jun, 2020 2 commits

[Distributed] support no shared memory. (#1663) · ff5b5a4a

Da Zheng authored Jun 18, 2020

* support no shared memory.

* add test.

* add CAPI to check existence of shared memory.

* revert the change in src/runtime/ndarray.cc

* update docstring.

* fix compile.

ff5b5a4a

[Optimization] Optimize pickling of heterograph (#1570) · 0a4e8b32

Qidong Su authored Jun 18, 2020



* update

* update

* update

* update

* update

* update

* backward compatibility

* update

* update

* update

* update

* update

* test

* test

* update

* update

* update

* update

* update

* update
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

0a4e8b32

17 Jun, 2020 2 commits

[RPC] HandleCtrlC Register for handling Ctrl+C event. (#1652) · 8fccdaf6
Chao Ma authored Jun 17, 2020
```
* update

* update

* update

* update

* fix lint
```
8fccdaf6

[KVStore] Add fast-pull for kvstore (#1647) · b372b3c7

Chao Ma authored Jun 17, 2020

* add fast-pull

* update

* add fast-pull

* update

* update

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* add omp

* update

* update

b372b3c7

15 Jun, 2020 2 commits

[Feature] Range partition (#1522) · 41349dce

Da Zheng authored Jun 15, 2020



* add reorder immutable graph.

* add python API.

* add reorder for csr.

* remove gk version.

* fix

* add cpp test.

* bug fixes

* fix tests.

* fix bugs and add check

* fix test.

* add omp.

* add comments.

* add coo reorder.

* fix a bug.

* handle reorder for different graph structues.

* fix lint.

* fix.

* add original ids.

* reshuffle nodes before metis partition.

* inner nodes are in contiguous Id range.

* reshuffle nodes/edges when partitioning.

* load partition return graph partition book.

* use inner_node/inner_edges

* add and test range partition book.

* count inner_edge correctly.

* fix lint.

* fix lint.

* fix lint.

* fix errors.

* fix errors.

* fix for TF.

* fix.

* fix.

* change docstring.

* support logical and.

* add comments.

* avoid copy.

* fix

* update docstring.

* fix a bug.

* add range search.

* fix

* fix a bug.

* add more tests.

* load graph partition book.

* support shared memory for range partition book.

* fix a bug.

* fix.

* fix lint.

* remove check

* fix test.

* remove num_nodes and num_edges

* fix lint.

* fix graph partition book.

* address comments.

* use makedirs.

* fix compile
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>

41349dce

[Kernel] CUDA CSR2COO COOSort COO2CSR (#1620) · d6d517bb

Minjie Wang authored Jun 15, 2020



* add cuda source

* moving codes from kernel2 branch

* operator overloading

* Better error message for unsupported device

* fix c tests

* coo sort using cusparse

* move test_rpc to distributed

* lint

* address comments and add utests
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

d6d517bb

11 Jun, 2020 2 commits
- [Fix] clang warnings (#1618) · 3ddc7b4d
  Jinjing Zhou authored Jun 11, 2020
```
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
```
  3ddc7b4d
- [RPC] Add send_request_to_machine() and remote_call_to_machine() (#1619) · a67ba946
  Chao Ma authored Jun 11, 2020
```
* add send_request_to_machine()

* update

* update

* update

* update

* update

* update

* fix lint

* update
```
  a67ba946
04 Jun, 2020 1 commit

[KVStore] Re-write kvstore using DGL RPC infrastructure (#1569) · 64f49703

Chao Ma authored Jun 04, 2020

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update init_data

* update server_state

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* debug init_data

* update

* update

* update

* update

* update

* update

* test get_meta_data

* update

* update

* update

* update

* update

* debug push

* update

* update

* update

* update

* update

* update

* update

* update

* update

* use F.reverse_data_type_dict

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* fix lint

* update

* fix lint

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* set random seed

* update

64f49703

27 May, 2020 1 commit
- [Bug] Fix PinSAGE crashes on hypersparse graphs (#1565) · d2e1cfce
  Quan (Andy) Gan authored May 27, 2020
  
  d2e1cfce
26 May, 2020 1 commit

[Fix] New StreamWithBuffer interface (#1557) · 7639b5e7

Jinjing Zhou authored May 27, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Refactor StreamWithBuffer (#1550)

* refactor

* fix with new interface

* remove copy

* fix

* remove comment
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Chao Ma <mctt90@gmail.com>

7639b5e7

25 May, 2020 1 commit
- [RPC] Init server_state during get_server_state() (#1559) · 6a363378
  Chao Ma authored May 25, 2020
```
* init server_state

* update

* update
```
  6a363378
22 May, 2020 1 commit

[RPC] New RPC infrastructure. (#1549) · 3e696922

Chao Ma authored May 22, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

3e696922

18 May, 2020 1 commit

[Performance] Reduces OpenMP atomic additions with zero inputs (#1527) · a296c1ef

pawelpiotrowicz authored May 18, 2020



* cirtical performance fix - reduce atomic

 * training faster up to 50%

* leave a TODO
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

a296c1ef

15 May, 2020 1 commit
- [Feature] Add a request_format api and enrich related docstring. (#1528) · 70dc2ee9
  Zihao Ye authored May 16, 2020
```
* upd

* upd

* lint

* fix

* bloody lint
```
  70dc2ee9
14 May, 2020 1 commit

[Refactor] Restrict sparse format for DGLHeteroGraph (#1474) · c2e61ce1

Zihao Ye authored May 14, 2020



* upd

* simplify

* further simplify

* lint

* doc

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* lint

* rename format

* upd

* lint

* upd

* upd

* upd

* udp

* debug

* upd

* upd

* upd

* upd

* upd

* 无可厚非吧

* 中三边肥

* 你一定要喊吗

* lint

* upd

* upd

* upd

* upd

* upd

* upd

* upd

* Update unit_graph.h
Co-authored-by: Zihao Ye <yzh119@192.168.0.110>
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Quan (Andy) Gan <coin2028@hotmail.com>

c2e61ce1

08 May, 2020 1 commit

[Refactor] Explicit dtype for HeteroGraph (#1467) · dc8ca88e

Jinjing Zhou authored May 08, 2020



* 111

* 111

* lint

* lint

* lint

* lint

* fix

* lint

* try

* fix

* lint

* lint

* test

* fix

* ttt

* test

* fix

* fix

* fix

* mxnet

* 111

* fix 64bits computation

* pylint

* roll back

* fix

* lint

* fix hetero_from_relations

* remove index_dtype in to_homo and to_hetero

* fix

* fix

* fix

* fix

* remove default

* fix

* lint

* fix

* fix error message

* fix error

* lint

* macro dispatch

* try

* lint

* remove nbits

* error message

* fix

* fix

* lint

* lint

* lint

* fix

* lint

* fix

* fix random walk

* lint

* lint

* fix

* fix

* fix

* lint

* fix

* lint
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>

dc8ca88e

03 May, 2020 1 commit

[Feature] Distributed graph store (#1383) · 2190c39d

Da Zheng authored May 02, 2020

* initial version from distributed training.

This is copied from multiprocessing training.

* modify for distributed training.

* it's runnable now.

* measure time in neighbor sampling.

* simplify neighbor sampling.

* fix a bug in distributed neighbor sampling.

* allow single-machine training.

* fix a bug.

* fix a bug.

* fix openmp.

* make some improvement.

* fix.

* add prepare in the sampler.

* prepare nodeflow async.

* fix a bug.

* get id.

* simplify the code.

* improve.

* fix partition.py

* fix the example.

* add more features.

* fix the example.

* allow one partition

* use distributed kvstore.

* do g2l map manually.

* fix commandline.

* a temp script to save reddit.

* fix pull_handler.

* add pytorch version.

* estimate the time for copying data.

* delete unused code.

* fix a bug.

* print id.

* fix a bug

* fix a bug

* fix a bug.

* remove redundent code.

* revert modify in sampler.

* fix temp script.

* remove pytorch version.

* fix.

* distributed training with pytorch.

* add distributed graph store.

* fix.

* add metis_partition_assignment.

* fix a few bugs in distributed graph store.

* fix test.

* fix bugs in distributed graph store.

* fix tests.

* remove code of defining DistGraphStore.

* fix partition.

* fix example.

* update run.sh.

* only read necessary node data.

* batching data fetch of multiple NodeFlows.

* simplify gcn.

* remove unnecessary code.

* use the new copy_from_kvstore.

* update training script.

* print time in graphsage.

* make distributed training runnable.

* use val_nid.

* fix train_sampling.

* add distributed training.

* add run.sh

* add more timing.

* fix a bug.

* save graph metadata when partition.

* create ndata and edata in distributed graph store.

* add timing in minibatch training of GraphSage.

* use pytorch distributed.

* add checks.

* fix a bug in global vs. local ids.

* remove fast pull

* fix a compile error.

* update and add new APIs.

* implement more methods in DistGraphStore.

* update more APIs.

* rename it to DistGraph.

* rename to DistTensor

* remove some unnecessary API.

* remove unnecessary files.

* revert changes in sampler.

* Revert "simplify gcn."

This reverts commit 0ed3a34ca714203a5b45240af71555d4227ce452.

* Revert "simplify neighbor sampling."

This reverts commit 551c72d20f05a029360ba97f312c7a7a578aacec.

* Revert "measure time in neighbor sampling."

This reverts commit 63ae80c7b402bb626e24acbbc8fdfe9fffd0bc64.

* Revert "add timing in minibatch training of GraphSage."

This reverts commit e59dc8957a414c7df5c316f51d78bce822bdef5e.

* Revert "fix train_sampling."

This reverts commit ea6aea9a4aabb8ba0ff63070aa51e7ca81536ad9.

* fix lint.

* add comments and small update.

* add more comments.

* add more unit tests and fix bugs.

* check the existence of shared-mem graph index.

* use new partitioned graph storage.

* fix bugs.

* print error in fast pull.

* fix lint

* fix a compile error.

* save absolute path after partitioning.

* small fixes in the example

* Revert "[kvstore] support any data type for init_data() (#1465)"

This reverts commit 87b6997b

.

* fix a bug.

* disable evaluation.

* Revert "Revert "[kvstore] support any data type for init_data() (#1465)""

This reverts commit f5b8039c6326eb73bad8287db3d30d93175e5bee.

* support set and init data.

* support set and init data.

* Revert "Revert "[kvstore] support any data type for init_data() (#1465)""

This reverts commit f5b8039c6326eb73bad8287db3d30d93175e5bee.

* fix bugs.

* fix unit test.

* move to dgl.distributed.

* fix lint.

* fix lint.

* remove local_nids.

* fix lint.

* fix test.

* remove train_dist.

* revert train_sampling.

* rename funcs.

* address comments.

* address comments.

Use NodeDataView/EdgeDataView to keep track of data.

* address comments.

* address comments.

* revert.

* save data with DGL serializer.

* use the right way of getting shape.

* fix lint.

* address comments.

* address comments.

* fix an error in mxnet.

* address comments.

* add edge_map.

* add more test and fix bugs.
Co-authored-by: Zheng <dzzhen@186590dc80ff.ant.amazon.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-6-131.us-east-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-26-167.us-east-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-150.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-16-250.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-30-135.us-west-2.compute.internal>

2190c39d

02 May, 2020 2 commits

[KVStore] Fix bug of get_meta() API (#1491) · 5fc334fc

Chao Ma authored May 02, 2020

* fix get-shape

* update

* update

* update

* update

* update

* fix typo

* update

* update

5fc334fc

[Fix] Fix stream creation and empty dict in tensor serialization (#1489) · 30b8074a

Jinjing Zhou authored May 02, 2020

* add functions

* fix litn

* add unit test

* fix

* fix

* fix

* fix

* support empty dict

* simplify logic

* Update tensor_serialize.py

30b8074a