1. 30 May, 2019 2 commits
    • VoVAllen's avatar
      [Test] Add cpp test to CI (#567) · 16af6ebd
      VoVAllen authored
      * add cpptest to ci
      
      * try windows
      
      * Update Jenkinsfile
      
      * Update Jenkinsfile
      
      * Update Jenkinsfile
      
      * Update task_cpp_unit_test.bat
      
      * Change localhost to 127.0.0.1
      
      * windows socket gtest
      
      * lint
      
      * Update task_cpp_unit_test.bat
      
      * fix batch script
      
      * export all symbols
      
      * Update Jenkinsfile
      
      * compile once
      
      * try mxnet compact
      16af6ebd
    • Da Zheng's avatar
      [Test] fix CI. (#586) · 40dc1859
      Da Zheng authored
      * disable unit test in mxnet tutorial.
      
      * retry socket connection.
      
      * roll back to set_np_compat
      
      * try to fix multi-processing test hangs when it fails.
      
      * fix test.
      
      * fix.
      40dc1859
  2. 27 May, 2019 1 commit
  3. 26 May, 2019 3 commits
  4. 25 May, 2019 1 commit
  5. 24 May, 2019 2 commits
  6. 23 May, 2019 2 commits
  7. 21 May, 2019 2 commits
    • Minjie Wang's avatar
      [Refactor] Immutable graph index (#543) · 605b5185
      Minjie Wang authored
      * WIP
      
      * header
      
      * WIP .cc
      
      * WIP
      
      * transpose
      
      * wip
      
      * immutable graph .h and .cc
      
      * WIP: nodeflow.cc
      
      * compile
      
      * remove all tmp dl managed ctx; they caused refcount issue
      
      * one simple test
      
      * WIP: testing
      
      * test_graph
      
      * fix graph index
      
      * fix bug in sampler; pass pytorch utest
      
      * WIP on mxnet
      
      * fix lint
      
      * fix mxnet unittest w/ unfortunate workaround
      
      * fix msvc
      
      * fix lint
      
      * SliceRows and test_nodeflow
      
      * resolve reviews
      
      * resolve reviews
      
      * try fix win ci
      
      * try fix win ci
      
      * poke win ci again
      
      * poke
      
      * lazy multigraph flag; stackoverflow error
      
      * revert node subgraph test
      
      * lazy object
      
      * try fix win build
      
      * try fix win build
      
      * poke ci
      
      * fix build script
      
      * fix compile
      
      * add a todo
      
      * fix reviews
      
      * fix compile
      605b5185
    • Da Zheng's avatar
      [API] update graph store API. (#549) · b2b8be25
      Da Zheng authored
      * add init_ndata and init_edata in DGLGraph.
      
      * adjust SharedMemoryGraph API.
      
      * print warning.
      
      * fix comment.
      
      * update example
      
      * fix.
      
      * fix examples.
      
      * add unit tests.
      
      * add comments.
      b2b8be25
  8. 20 May, 2019 2 commits
    • Da Zheng's avatar
      [BUGFix] Improve multi-processing training (#526) · cdfca992
      Da Zheng authored
      * fix.
      
      * add comment.
      
      * remove.
      
      * temp fix.
      
      * initialize for shared memory.
      
      * fix graphsage.
      
      * fix gcn.
      
      * add more unit tests.
      
      * add more tests.
      
      * avoid creating shared-memory exclusively.
      
      * redefine remote initializer.
      
      * improve initializer.
      
      * fix unit test.
      
      * fix lint.
      
      * fix lint.
      
      * initialize data in the graph store server properly.
      
      * fix test.
      
      * fix test.
      
      * fix test.
      
      * small fix.
      
      * add comments.
      
      * cleanup server.
      
      * test graph store with a random port.
      
      * print.
      
      * print to stderr.
      
      * test1
      
      * test2
      
      * remove comment.
      
      * adjust the initializer signature.
      cdfca992
    • VoVAllen's avatar
      [Feature] Add batch and unbatch for immutable graph (#539) · 4b761571
      VoVAllen authored
      * Add batch and unbatch for immutable graph
      
      * fix line seprator
      
      * fix lintr
      
      * remove unnecessary include
      
      * fix code review
      4b761571
  9. 17 May, 2019 1 commit
  10. 07 May, 2019 1 commit
    • Da Zheng's avatar
      [Model] add multiprocessing training with sampling. (#484) · 3a1392e6
      Da Zheng authored
      * reorganize sampling code.
      
      * add multi-process training.
      
      * speed up gcn_cv
      
      * fix graphsage_cv.
      
      * add new API in graph store.
      
      * update barrier impl.
      
      * support both local and distributed training.
      
      * fix multiprocess train.
      
      * fix.
      
      * fix barrier.
      
      * add script for loading data.
      
      * multiprocessing sampling.
      
      * accel training.
      
      * replace pull with spmv for speedup.
      
      * nodeflow copy from parent with context.
      
      * enable GPU.
      
      * fix a bug in graph store.
      
      * enable multi-GPU training.
      
      * fix lint.
      
      * add comments.
      
      * rename to run_store_server.py
      
      * fix gcn_cv.
      
      * fix a minor bug in sampler.
      
      * handle error better in graph store.
      
      * improve graphsage_cv for distributed mode.
      
      * update README.
      
      * fix.
      
      * update.
      3a1392e6
  11. 22 Apr, 2019 1 commit
  12. 16 Apr, 2019 2 commits
  13. 08 Apr, 2019 1 commit
    • Da Zheng's avatar
      [Feature] Create shared memory graph store. (#468) · bfdd1eaa
      Da Zheng authored
      * accelerate gcn_ns.
      
      * add timing.
      
      * run infer with whole graph.
      
      * distributed gcn_ns.
      
      * reconstruct gcn_ns.
      
      * minor fix.
      
      * change graphsage_cv for numa.
      
      * fix #OMP threads.
      
      * accelerate graphsage_cv.
      
      * fix a weird bug.
      
      * add profiler in graphsage_cv.
      
      * accelerate graphsage_cv.
      
      manually aggregate neighbors' embeddings with pull.
      
      * load csr directly in gcn_ns_sc.
      
      * parallel sort for graph index.
      
      * Revert "parallel sort for graph index."
      
      This reverts commit 86fe2c7117fe5e56b0d481b39849c258b166945b.
      
      * run gcn_ns_sc on GPUs.
      
      * acc gcn_cv_sc.
      
      * change gcn_cv for numa.
      
      * fix gcn_cv to use numa and gpu.
      
      * improve graphsage_cv to use numa and gpu.
      
      * improve gcn_ns.
      
      * improve graphsage_cv.
      
      * init shared memory graph store.
      
      * fix.
      
      * enable init ndata.
      
      * improve tests.
      
      * add bidirectional communication.
      
      * link to rt.
      
      * fix compilation error.
      
      * fix shared memory init.
      
      * use MessageQueue for inter-process communication.
      
      * reconstruct immutable graph csr.
      
      * fix gcn.
      
      * load csr to shared memory.
      
      * fix minor bugs.
      
      * add comments.
      
      * refactor SharedMemory.
      
      * fix bugs in ImmutableGraph.
      
      * create CSR graph from shared memory.
      
      * add more test for loading a csr graph.
      
      * terminate graph store properly.
      
      * allow initializing ndata in the graph store server.
      
      * use RPC for inter-process communication.
      
      * a script for loading a graph.
      
      * allow customizing port.
      
      * list all ndata and edata.
      
      * support dtype.
      
      * reorganize SharedMemoryGraphStore.
      
      * fix ndata shape.
      
      * reconstruct gcn_ns.
      
      * print info.
      
      * set omp in gcn_ns.
      
      * reset sampling examples.
      
      * fix lint.
      
      * fix lint.
      
      * reset gcn.
      
      * disable shared memory in windows.
      
      * fix.
      
      * fix.
      
      * reset changes.
      
      * revert nodeflow changes.
      
      * fix cmake.
      
      * fix test.
      
      * fix test.
      
      * fix test.
      
      * fix test.
      
      * add comments.
      
      * fix test.
      
      * move vector out.
      
      * fix lint.
      
      * fix lint.
      
      * move SharedMemory.
      
      * update cmake.
      
      * update comment.
      
      * fix comments.
      
      * Revert "update cmake."
      
      This reverts commit 592445e37077f70a6e3f2e5245f9a3d086b04f3b.
      
      * update cmake.
      
      * add comments.
      
      * rename.
      
      * change the comment.
      
      * fix a bug.
      
      * rename.
      
      * add comments.
      
      * add comments.
      
      * add init_edata.
      
      * rewrite memory alloc.
      
      * move vector to CSR.
      
      * fix.
      
      * init data.
      
      * Revert "init data."
      
      This reverts commit 2b217b9553911b7dd84a9f1d9b68430b5aa18e23.
      
      * init data.
      
      * init new columns correctly.
      bfdd1eaa
  14. 29 Mar, 2019 2 commits
    • Chao Ma's avatar
      [RPC] add C++ RPC infrastructure and distributed sampler (#465) · 5d494c62
      Chao Ma authored
      * add C++ rpc infrastructure and distributed sampler
      
      * update
      
      * update lint
      
      * update lint
      
      * update lint
      
      * update
      
      * update
      
      * update
      
      * updare
      
      * update
      
      * update
      
      * update
      
      * update serialize and unittest
      
      * update serialize
      
      * lint
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update unittest
      
      * put Finalize() to __del__
      
      * update unittest
      
      * update
      
      * delete buffer in Finalize
      
      * update unittest
      
      * update unittest
      
      * update unittest
      
      * update unittest
      
      * update
      
      * update
      
      * fix small bug
      
      * windows socket impl
      
      * update API
      
      * fix bug in serialize
      
      * fix bug in serialzie
      
      * set parent graph
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * fix lint
      
      * fix lint
      
      * fix
      
      * fix windows compilation error
      
      * fix windows error
      
      * change API to lower-case
      
      * update test
      
      * fix typo
      
      * update
      
      * add SamplerPool
      
      * add SamplerPool
      
      * update
      
      * update test
      
      * update
      
      * update
      
      * update
      
      * update
      
      * add example
      
      * update
      
      * update
      5d494c62
    • Quan (Andy) Gan's avatar
      [Model][Feature] PinSage & Random Walk with Restart (#453) · 6066fee9
      Quan (Andy) Gan authored
      * random walk traces generation
      
      * remove outdated comments
      
      * oops put in the wrong place
      
      * explicit inline
      
      * moving rand_r to util
      
      * pinsage-like model on movielens
      
      * the code runs now
      
      * support cuda
      
      * using readonly graph
      
      * moving random walk to public function
      
      * per-thread seed and openmp support
      
      * pinsage-like model on movielens
      
      * the code runs now
      
      * support cuda
      
      * using readonly graph
      
      * using C random walk
      
      * removing profile decorators
      
      * param initialization
      
      * no grad
      
      * leaky relu fixes everything
      
      * train and save
      
      * WIP
      
      * WIP
      
      * WIP
      
      * seems to work
      
      * evaluation output
      
      * swapping order of val/test and train
      
      * debug
      
      * hyperparam tuning
      
      * prior/training dataset split changes
      
      * random walk reorg
      
      * random walk with restart
      
      * signed comparison fix
      
      * migrating random walk to nodeflow
      
      * Revert "migrating random walk to nodeflow"
      
      This reverts commit f2565347cced7c912a58a529b257c033d9f375b7.
      
      * add README and remove dataset
      
      * new endpoint
      
      * lint
      
      * lint x2
      
      * oops forgot test
      
      * including bpr - better for baseline
      
      * addressing fixes
      
      * throwing random walks out from SamplerOp class
      
      * forgot to move RandomWalk; why did this even work?
      
      * removing legacy garbage
      
      * add todo
      
      * address comments
      
      * stupid bug fix
      
      * call ndarrayvector converter to handle traces
      6066fee9
  15. 19 Mar, 2019 1 commit
  16. 13 Mar, 2019 2 commits
  17. 08 Mar, 2019 1 commit
  18. 07 Mar, 2019 1 commit
    • Da Zheng's avatar
      [Perf] Accelerate block_compute when all nodes are invoked. (#434) · 8651be54
      Da Zheng authored
      * refactor.
      
      * accelerate update_all in nodeflow.
      
      * fix.
      
      * refactor.
      
      * fix lint.
      
      * fix lint.
      
      * reorganize.
      
      * reorg.
      
      * remove.
      
      * add doc.
      
      * impl block_incidence_matrix
      
      * fix lint.
      
      * fix.
      
      * simple fix.
      
      * fix test.
      
      * fix interface.
      
      * fix eid.
      
      * fix comments.
      8651be54
  19. 05 Mar, 2019 1 commit
    • Minjie Wang's avatar
      [Refactor] Nodeflow, sampling, CAPI (#430) · ca2a7e1c
      Minjie Wang authored
      * enable cython
      
      * add helper function and data structure for void_p vector return
      
      * move sampler from graph index to contrib.sampling
      
      * WIP
      
      * WIP
      
      * refactor layer sampling
      
      * pass tests
      
      * fix lint
      
      * fix graphsage
      
      * remove comments
      
      * pickle test
      
      * fix comments
      
      * update dev guide for cython build
      ca2a7e1c
  20. 03 Mar, 2019 1 commit
    • GaiYu0's avatar
      [Feature]Uniform layer-wise sampler (#416) · fb4246e5
      GaiYu0 authored
      * migrate to node-flow
      
      * uniform layer sampler test cases
      
      * more test cases
      
      * documentations
      
      * fix lint errors
      
      * fix lint errors
      
      * fix lint errors
      
      * iota
      
      * add asnumpy
      
      * requested changes
      
      * fix indptr error
      
      * fix lint errors
      
      * requested changes & fix lint errors
      
      * fix lint errors
      
      * fix LayerSampler unit test
      fb4246e5
  21. 28 Feb, 2019 2 commits
  22. 27 Feb, 2019 1 commit
    • Zihao Ye's avatar
      [Feature] FindEdge/FindEdges for Immutable Graph (#404) · 724aa0ca
      Zihao Ye authored
      * fix rgcn tutorial
      
      * small fix
      
      * upd
      
      * findedge/s
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * add test
      
      * remove redundancy
      
      * upd
      
      * upd
      
      * upd
      
      * upd
      
      * add edge_subgraph
      
      * explicit cast
      
      * add test immutable subg
      
      * reformat
      
      * reformat
      
      * fix bug
      
      * upd
      724aa0ca
  23. 25 Feb, 2019 1 commit
    • Minjie Wang's avatar
      [WIP] [NN] Refactor NN package (#406) · 565f0c88
      Minjie Wang authored
      * refactor graph conv
      
      * docs & tests
      
      * fix lint
      
      * fix lint
      
      * fix lint
      
      * fix lint script
      
      * fix lint
      
      * Update
      
      * Style fix
      
      * Fix style
      
      * Fix style
      
      * Fix gpu case
      
      * Fix for gpu case
      
      * Hotfix edgesoftmax docs
      
      * Handle repeated features
      
      * Add docstring
      
      * Set default arguments
      
      * Remove dropout from nn.conv
      
      * Fix
      
      * add util fn for renaming
      
      * revert gcn_spmv.py
      
      * mx folder
      
      * fix wierd bug
      
      * fix mx
      
      * fix lint
      565f0c88
  24. 20 Feb, 2019 2 commits
    • Zihao Ye's avatar
      [Feature] Add switch readonly state interface (#389) · bfe3e9d6
      Zihao Ye authored
      * fix rgcn tutorial
      
      * small fix
      
      * add switch readonly state interface
      
      * remove trailing ws
      
      * fix
      
      * fix
      
      * change signature
      
      * change signature
      
      * remove trailing ws
      
      * upd
      
      * upd interface
      
      * upd
      
      * rm trailing ws
      
      * reformat
      
      * trailing space
      
      * upd
      bfe3e9d6
    • Quan (Andy) Gan's avatar
      [Feature] Random walk traces generation (#392) · 2e1cbd5d
      Quan (Andy) Gan authored
      * random walk traces generation
      
      * remove outdated comments
      
      * oops put in the wrong place
      
      * explicit inline
      
      * moving rand_r to util
      
      * moving random walk to public function
      
      * per-thread seed and openmp support
      
      * type cast styles
      2e1cbd5d
  25. 19 Feb, 2019 2 commits
    • Da Zheng's avatar
      [Feature] add NodeFlow API (#361) · f370e628
      Da Zheng authored
      * sample layer subgraphs.
      
      * fix.
      
      * fix.
      
      * add layered subgraph.
      
      * fix lint.
      
      * fix.
      
      * fix tutorial.
      
      * fix.
      
      * remove copy_to_parent.
      
      * add num_layers
      
      * move sampling code to sampler.cc
      
      * fix.
      
      * move subgraph construction out.
      
      * Revert "move subgraph construction out."
      
      This reverts commit 24b3d13b0d8ed5f91847ea75a7674ee8f7d45cff.
      
      * change to NodeFlow.
      
      * use NodeFlow in Python.
      
      * use NodeFlowIndex.
      
      * add node_mapping and edge_mapping.
      
      * remove unnecessary code in SSE tutorial.
      
      * Revert "remove unnecessary code in SSE tutorial."
      
      This reverts commit 093f0413d5fa2e63ca5f80c46c80a126a9fb720c.
      
      * fix tutorial.
      
      * move to node_flow.
      
      * update gcn cv updater.
      
      * import NodeFlow.
      
      * update.
      
      * add demo code for vanilla control variate sampler.
      
      * update.
      
      * update.
      
      * add neighbor sampling.
      
      * return flow offsets.
      
      * update node_flow.
      
      * add test.
      
      * fix sampler.
      
      * fix graph index.
      
      * fix a bug in sampler.
      
      * fix map_to_layer_nid and map_to_flow_eid.
      
      * fix apply_flow.
      
      * remove model code.
      
      * implement flow_compute.
      
      * fix a bug.
      
      * reverse the csr physically.
      
      * add mini-batch test.
      
      * add mini batch test.
      
      * update flow_compute.
      
      * add prop_flows
      
      * run on specific nodes.
      
      * test copy
      
      * fix a bug in creating frame in NodeFlow.
      
      * add init gcn_cv_updater.
      
      * fix a minor bug.
      
      * fix gcn_cv_updater.
      
      * fix a bug.
      
      * fix a bug in NodeFlow.
      
      * use new h in gcn_cv_updater.
      
      * add layer_in_degree and layer_out_degree.
      
      * fix gcn_cv_updater for gpu.
      
      * temp fix in NodeFlow for diff context.
      
      * allow enabling/disabling copy back.
      
      * add with-updater option.
      
      * fix a bug in computing degree.
      
      * add with-cv option.
      
      * rename and add comments.
      
      * fix lint complain.
      
      * fix lint.
      
      * avoid assert.
      
      * remove assert.
      
      * fix.
      
      * fix.
      
      * fix.
      
      * fix.
      
      * fix the methods in NodeFlow.
      
      * fix lint.
      
      * update SSE.
      
      * remove gcn_cv_updater.
      
      * correct comments for the schedulers.
      
      * update comment.
      
      * add map_to_nodeflow_nid
      
      * address comment.
      
      * remove duplicated test.
      
      * fix int.
      
      * fix comments.
      
      * fix lint
      
      * fix.
      
      * replace subgraph with NodeFlow.
      
      * move view.
      
      * address comments.
      
      * fix lint.
      
      * fix lint.
      
      * remove static_cast.
      
      * fix docstring.
      
      * fix comments.
      
      * break SampleSubgraph.
      
      * move neighbor sampling to sampler.cc
      
      * fix comments.
      
      * rename.
      
      * split neighbor_list.
      
      * address comments.
      
      * fix.
      
      * remove TODO.
      f370e628
    • Quan (Andy) Gan's avatar
      [BUG] Fixing bug in pickling readonly graphs (#397) · 220a1e68
      Quan (Andy) Gan authored
      * fixing bug in pickling readonly graphs
      
      * multigraph test coverage
      
      * fixing lint (??????)
      
      * another lint
      
      * is_readonly interface
      220a1e68
  26. 03 Feb, 2019 1 commit
    • VoVAllen's avatar
      [Feature] Edge Group Apply API (#358) · 5b9147c4
      VoVAllen authored
      * add rtfd
      
      * rrr
      
      * update
      
      * change env
      
      * temp fix
      
      * update
      
      * fix
      
      * fix
      
      * add
      
      * conf
      
      * Move file_pattern from Makefile to conf.py
      
      * remove yml
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * remove yml
      
      * remove yml
      
      * add doc docker
      
      * add dgl install script
      
      * change name
      
      * change dockerfile
      
      * fix
      
      * name
      
      * add
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix docker
      
      * delete sphinx.py for doc-build backend
      
      * Add softmax to test backend
      
      * Add group apply function and tests
      
      * Delete unnecessary file
      
      * Update comments and test
      
      * Fix lint
      
      * remove unused bucketing code
      
      * group apply edge bucketing code
      
      * gen degree bucket schedule for group apply edge
      
      * schedule and graph code
      
      * fix compiling
      
      * fix
      
      * fix lint
      
      * naming
      
      * harder test case
      
      * fix comments
      
      * more comments
      
      * tweak function name
      5b9147c4
  27. 25 Jan, 2019 1 commit