1. 20 May, 2019 1 commit
    • Da Zheng's avatar
      [BUGFix] Improve multi-processing training (#526) · cdfca992
      Da Zheng authored
      * fix.
      
      * add comment.
      
      * remove.
      
      * temp fix.
      
      * initialize for shared memory.
      
      * fix graphsage.
      
      * fix gcn.
      
      * add more unit tests.
      
      * add more tests.
      
      * avoid creating shared-memory exclusively.
      
      * redefine remote initializer.
      
      * improve initializer.
      
      * fix unit test.
      
      * fix lint.
      
      * fix lint.
      
      * initialize data in the graph store server properly.
      
      * fix test.
      
      * fix test.
      
      * fix test.
      
      * small fix.
      
      * add comments.
      
      * cleanup server.
      
      * test graph store with a random port.
      
      * print.
      
      * print to stderr.
      
      * test1
      
      * test2
      
      * remove comment.
      
      * adjust the initializer signature.
      cdfca992
  2. 07 May, 2019 1 commit
    • Da Zheng's avatar
      [Model] add multiprocessing training with sampling. (#484) · 3a1392e6
      Da Zheng authored
      * reorganize sampling code.
      
      * add multi-process training.
      
      * speed up gcn_cv
      
      * fix graphsage_cv.
      
      * add new API in graph store.
      
      * update barrier impl.
      
      * support both local and distributed training.
      
      * fix multiprocess train.
      
      * fix.
      
      * fix barrier.
      
      * add script for loading data.
      
      * multiprocessing sampling.
      
      * accel training.
      
      * replace pull with spmv for speedup.
      
      * nodeflow copy from parent with context.
      
      * enable GPU.
      
      * fix a bug in graph store.
      
      * enable multi-GPU training.
      
      * fix lint.
      
      * add comments.
      
      * rename to run_store_server.py
      
      * fix gcn_cv.
      
      * fix a minor bug in sampler.
      
      * handle error better in graph store.
      
      * improve graphsage_cv for distributed mode.
      
      * update README.
      
      * fix.
      
      * update.
      3a1392e6
  3. 25 Apr, 2019 1 commit
  4. 22 Apr, 2019 1 commit
  5. 17 Apr, 2019 1 commit
  6. 16 Apr, 2019 1 commit
    • Chao Ma's avatar
      [RPC] Refactoring networking APIs (#496) · b89dcce1
      Chao Ma authored
      * Refactoring network API
      
      * update demo
      
      * update
      
      * update demo
      
      * update demo
      
      * add num_sender
      
      * update
      
      * fix lint
      
      * fix lint
      
      * fix lint
      
      * update
      b89dcce1
  7. 11 Apr, 2019 1 commit
  8. 10 Apr, 2019 1 commit
  9. 05 Apr, 2019 1 commit
  10. 03 Apr, 2019 1 commit
    • Chao Ma's avatar
      Add demo for distributed sampler (#474) · da3ab84c
      Chao Ma authored
      * add C++ rpc infrastructure and distributed sampler
      
      * update
      
      * update lint
      
      * update lint
      
      * update lint
      
      * update
      
      * update
      
      * update
      
      * updare
      
      * update
      
      * update
      
      * update
      
      * update serialize and unittest
      
      * update serialize
      
      * lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update unittest
      
      * put Finalize() to __del__
      
      * update unittest
      
      * update
      
      * delete buffer in Finalize
      
      * update unittest
      
      * update unittest
      
      * update unittest
      
      * update unittest
      
      * update
      
      * update
      
      * fix small bug
      
      * windows socket impl
      
      * update API
      
      * fix bug in serialize
      
      * fix bug in serialzie
      
      * set parent graph
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix lint
      
      * fix lint
      
      * fix
      
      * fix windows compilation error
      
      * fix windows error
      
      * change API to lower-case
      
      * update test
      
      * fix typo
      
      * update
      
      * add SamplerPool
      
      * add SamplerPool
      
      * update
      
      * update test
      
      * update
      
      * update
      
      * update
      
      * update
      
      * add example
      
      * update
      
      * update
      
      * add distributed sampler demo
      
      * add index
      
      * update demo of distributed sampler
      
      * fix lower-case
      
      * print subg index
      
      * update README.md
      
      * update
      
      * remove --gpu args
      da3ab84c
  11. 05 Mar, 2019 1 commit
    • Minjie Wang's avatar
      [Refactor] Nodeflow, sampling, CAPI (#430) · ca2a7e1c
      Minjie Wang authored
      * enable cython
      
      * add helper function and data structure for void_p vector return
      
      * move sampler from graph index to contrib.sampling
      
      * WIP
      
      * WIP
      
      * refactor layer sampling
      
      * pass tests
      
      * fix lint
      
      * fix graphsage
      
      * remove comments
      
      * pickle test
      
      * fix comments
      
      * update dev guide for cython build
      ca2a7e1c
  12. 28 Feb, 2019 2 commits
  13. 25 Feb, 2019 1 commit
    • Minjie Wang's avatar
      [WIP] [NN] Refactor NN package (#406) · 565f0c88
      Minjie Wang authored
      * refactor graph conv
      
      * docs & tests
      
      * fix lint
      
      * fix lint
      
      * fix lint
      
      * fix lint script
      
      * fix lint
      
      * Update
      
      * Style fix
      
      * Fix style
      
      * Fix style
      
      * Fix gpu case
      
      * Fix for gpu case
      
      * Hotfix edgesoftmax docs
      
      * Handle repeated features
      
      * Add docstring
      
      * Set default arguments
      
      * Remove dropout from nn.conv
      
      * Fix
      
      * add util fn for renaming
      
      * revert gcn_spmv.py
      
      * mx folder
      
      * fix wierd bug
      
      * fix mx
      
      * fix lint
      565f0c88
  14. 19 Feb, 2019 1 commit
    • Da Zheng's avatar
      [Feature] add NodeFlow API (#361) · f370e628
      Da Zheng authored
      * sample layer subgraphs.
      
      * fix.
      
      * fix.
      
      * add layered subgraph.
      
      * fix lint.
      
      * fix.
      
      * fix tutorial.
      
      * fix.
      
      * remove copy_to_parent.
      
      * add num_layers
      
      * move sampling code to sampler.cc
      
      * fix.
      
      * move subgraph construction out.
      
      * Revert "move subgraph construction out."
      
      This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
      
      * change to NodeFlow.
      
      * use NodeFlow in Python.
      
      * use NodeFlowIndex.
      
      * add node_mapping and edge_mapping.
      
      * remove unnecessary code in SSE tutorial.
      
      * Revert "remove unnecessary code in SSE tutorial."
      
      This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
      
      * fix tutorial.
      
      * move to node_flow.
      
      * update gcn cv updater.
      
      * import NodeFlow.
      
      * update.
      
      * add demo code for vanilla control variate sampler.
      
      * update.
      
      * update.
      
      * add neighbor sampling.
      
      * return flow offsets.
      
      * update node_flow.
      
      * add test.
      
      * fix sampler.
      
      * fix graph index.
      
      * fix a bug in sampler.
      
      * fix map_to_layer_nid and map_to_flow_eid.
      
      * fix apply_flow.
      
      * remove model code.
      
      * implement flow_compute.
      
      * fix a bug.
      
      * reverse the csr physically.
      
      * add mini-batch test.
      
      * add mini batch test.
      
      * update flow_compute.
      
      * add prop_flows
      
      * run on specific nodes.
      
      * test copy
      
      * fix a bug in creating frame in NodeFlow.
      
      * add init gcn_cv_updater.
      
      * fix a minor bug.
      
      * fix gcn_cv_updater.
      
      * fix a bug.
      
      * fix a bug in NodeFlow.
      
      * use new h in gcn_cv_updater.
      
      * add layer_in_degree and layer_out_degree.
      
      * fix gcn_cv_updater for gpu.
      
      * temp fix in NodeFlow for diff context.
      
      * allow enabling/disabling copy back.
      
      * add with-updater option.
      
      * fix a bug in computing degree.
      
      * add with-cv option.
      
      * rename and add comments.
      
      * fix lint complain.
      
      * fix lint.
      
      * avoid assert.
      
      * remove assert.
      
      * fix.
      
      * fix.
      
      * fix.
      
      * fix.
      
      * fix the methods in NodeFlow.
      
      * fix lint.
      
      * update SSE.
      
      * remove gcn_cv_updater.
      
      * correct comments for the schedulers.
      
      * update comment.
      
      * add map_to_nodeflow_nid
      
      * address comment.
      
      * remove duplicated test.
      
      * fix int.
      
      * fix comments.
      
      * fix lint
      
      * fix.
      
      * replace subgraph with NodeFlow.
      
      * move view.
      
      * address comments.
      
      * fix lint.
      
      * fix lint.
      
      * remove static_cast.
      
      * fix docstring.
      
      * fix comments.
      
      * break SampleSubgraph.
      
      * move neighbor sampling to sampler.cc
      
      * fix comments.
      
      * rename.
      
      * split neighbor_list.
      
      * address comments.
      
      * fix.
      
      * remove TODO.
      f370e628
  15. 12 Feb, 2019 1 commit
  16. 03 Feb, 2019 1 commit
  17. 12 Jan, 2019 1 commit
    • Minjie Wang's avatar
      [Bugfix] Fix gat residual bug (#355) · ddc2faa5
      Minjie Wang authored
      * fix gat residual bug
      
      * fix the residual addition; output heads; add some shape notations;
      
      * minor
      
      * fix the output head average
      
      * add requests package in requirement
      ddc2faa5
  18. 11 Jan, 2019 1 commit
  19. 27 Dec, 2018 1 commit
  20. 24 Dec, 2018 1 commit
  21. 17 Dec, 2018 4 commits
  22. 16 Dec, 2018 1 commit
  23. 06 Dec, 2018 1 commit
    • Gan Quan's avatar
      [Doc] Readme (#265) · ac660f45
      Gan Quan authored
      * [Doc] updated readme
      
      * contribution guide change
      
      * small edits
      
      * add perf #
      
      * Update README.md
      
      * Update README.md
      
      * add others...
      
      * rewrite scalability
      
      * model & code links
      
      * some note for treelstm
      
      * rewrite scalability
      ac660f45
  24. 05 Dec, 2018 4 commits
  25. 04 Dec, 2018 2 commits
  26. 03 Dec, 2018 2 commits
  27. 02 Dec, 2018 1 commit
    • Da Zheng's avatar
      [Model] Accelerate SSE (#172) · 57b07fce
      Da Zheng authored
      * lazy eval edge ids.
      
      * parallelize node id lookup.
      
      * fix a bug.
      
      * use mxnet for index.
      
      * use update_all in the subgraph training.
      
      * sample neighbors.
      
      * Revert "parallelize node id lookup."
      
      This reverts commit e661f69bb06cb5a7c246f0e106f245e27800e220.
      
      * update README.
      
      * cache subgraphs.
      
      * support all degrees.
      
      * cache adj in CPU.
      
      * fix a bug in sse.
      
      * print.
      
      * raise error on mutable graphs.
      
      * measure train time per epoch.
      
      * fix a bug in graph_index.
      
      * remove readonly in DGLSubGraph.
      
      * cache subgraph properly.
      
      * accelerate getting adjacency.
      
      * split infer.
      
      * lazy eval edges.
      
      * specify inference mode.
      
      * update for new sampler.
      
      * use new mxnet sampling api.
      
      * fix indent.
      
      * remove profiling code.
      
      * remove mxnet from sampler.
      
      * return a lambda function for graph edges.
      
      * add docs for immutable subgraph.
      
      * Revert "return a lambda function for graph edges."
      
      This reverts commit 0de5d7f100e230c518a3fb8976a6227f474d09ee.
      
      * get parent_eid.
      57b07fce
  28. 27 Nov, 2018 1 commit
  29. 20 Nov, 2018 1 commit
    • Da Zheng's avatar
      Fix the convergence problem in SSE. (#162) · 5f89cd66
      Da Zheng authored
      * add a test.
      
      * move file.
      
      * debug
      
      * add degree normalization.
      
      * it can converge now.
      
      * remove hidden_data.
      
      * use readonly graph index.
      
      * use subgraph loader.
      
      * refactor code and remove intermediate data.
      
      * split inference.
      
      * mix cpu and gpu training.
      
      * fix mxnet sparse_matrix constructor.
      
      * convert tensor context.
      
      * set up the prediction model.
      
      * load mxnet csr directly.
      
      * add timing.
      
      * move test_sse.py to sse_batch.py
      
      * fix the tensor version of SSE.
      
      * update README.
      5f89cd66
  30. 14 Nov, 2018 1 commit
    • Da Zheng's avatar
      [API] Subgraph sampling API. (#138) · 2389df81
      Da Zheng authored
      * add neighbor sampler.
      
      * fix sampler.
      
      * handle non-existing nodes differently in MapParentIdToSubgraphId.
      
      * fix sampling tests.
      
      * parallelize sampling.
      
      * add more tests.
      
      * fix a bug in subgraph loader.
      
      * get number of sampled nodes directly.
      
      * load mxnet CSR to DGLGraph directly.
      
      * create graph from mxnet csr array directly.
      
      * use subgraph loader in SSE.
      
      * fix a bug in sampling.
      
      * output framework tensor.
      
      * fix.
      
      * remove unnecessary code.
      
      * fix tests.
      
      * add SSE README.
      
      * move to contrib.
      
      * address comments.
      
      * add tests.
      2389df81
  31. 08 Nov, 2018 1 commit
    • Da Zheng's avatar
      [MXNet][API] move to the new API (#123) · bd0e4fa0
      Da Zheng authored
      * move gat to the new api.
      
      * fix gcn.
      
      * update sse.
      
      * fix dgl core.
      
      * update sse.
      
      * fix small bugs in dgl core.
      
      * fix mxnet tests.
      
      * retrigger
      
      * address comments and fix more bugs.
      
      * fix
      
      * fix tests.
      bd0e4fa0