1. 09 Mar, 2020 1 commit
  2. 05 Mar, 2020 1 commit
  3. 04 Mar, 2020 1 commit
  4. 02 Mar, 2020 1 commit
    • Chao Ma's avatar
      [DGL-KE] Distributed training of DGL-KE (#1290) · 00ba4094
      Chao Ma authored
      * update
      
      * change name
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * change worker number
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * test
      
      * update
      
      * update
      
      * update
      
      * remove barrier
      
      * max_step
      
      * update
      
      * add complex
      
      * update
      
      * chmod +x
      
      * update
      
      * update
      
      * random partition
      
      * random partition
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * update
      
      * change num_test_proc
      
      * update num_thread
      
      * update
      00ba4094
  5. 18 Feb, 2020 1 commit
  6. 16 Feb, 2020 1 commit
    • xiang song(charlie.song)'s avatar
      [KG][Optimization] Soft relation partition (#1252) · 49fe5b3c
      xiang song(charlie.song) authored
      * Several optimizations on DGL-KG:
      1. Sorted positive edges for sampling which can reduce random
         memory access during positive sampling
      2. Asynchronous node embedding update
      3. Balanced Relation Partition that gives balanced number of
         edges in each partition. When there is no cross partition
         relation, relation embedding can be pin into GPU memory
      4. tunable neg_sample_size instead of fixed neg_sample_size
      
      * Fix test
      
      * Fix test and eval.py
      
      * Now TransR is OK
      
      * Fix single GPU with mix_cpu_gpu
      
      * Add app tests
      
      * Fix test script
      
      * fix mxnet
      
      * Fix sample
      
      * Add docstrings
      
      * Fix
      
      * Default value for num_workers
      
      * Add soft relation part
      
      * Upd
      
      * Some fix
      
      * upd
      
      * Now work
      
      * Fix TransR
      
      * Fix eval and add some doc string
      
      * triger
      
      * upd
      
      * Add some training scripts for freebase multi-gpu
      
      * upd
      
      * upd
      
      * upd
      49fe5b3c
  7. 09 Feb, 2020 1 commit
    • xiang song(charlie.song)'s avatar
      [Optimization][KG] Several optimizations on DGL-KG (#1233) · ffe58983
      xiang song(charlie.song) authored
      * Several optimizations on DGL-KG:
      1. Sorted positive edges for sampling which can reduce random
         memory access during positive sampling
      2. Asynchronous node embedding update
      3. Balanced Relation Partition that gives balanced number of
         edges in each partition. When there is no cross partition
         relation, relation embedding can be pin into GPU memory
      4. tunable neg_sample_size instead of fixed neg_sample_size
      
      * Fix test
      
      * Fix test and eval.py
      
      * Now TransR is OK
      
      * Fix single GPU with mix_cpu_gpu
      
      * Add app tests
      
      * Fix test script
      
      * fix mxnet
      
      * Fix sample
      
      * Add docstrings
      
      * Fix
      
      * Default value for num_workers
      
      * Upd
      
      * upd
      ffe58983
  8. 08 Feb, 2020 1 commit
  9. 03 Feb, 2020 1 commit
    • Mufei Li's avatar
      [DGL-LifeSci] Migration and Refactor (#1226) · 828a5e5b
      Mufei Li authored
      * First commit
      
      * Update
      
      * Update splitters
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Migrate ACNN
      
      * Fix
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Update
      
      * Finish classification
      
      * Update
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * Fix
      
      * Fix
      
      * Fix
      
      * Update
      
      * Update
      
      * Update
      
      * trigger CI
      
      * Fix CI
      
      * Update
      
      * Update
      
      * Update
      
      * Add default values
      
      * Rename
      
      * Update deprecation message
      828a5e5b
  10. 10 Jan, 2020 1 commit
  11. 08 Jan, 2020 1 commit
    • xiang song(charlie.song)'s avatar
      [Feature][KG] Multi-GPU training support for DGL KGE (#1178) · bb6a6476
      xiang song(charlie.song) authored
      * multi-gpu
      
      * Pytorch can run but test has acc problem
      
      * pytorch train/eval can run in multi-gpu
      
      * Fix eval
      
      * Fix
      
      * Fix mxnet
      
      * trigger
      
      * triger
      
      * Fix mxnet score_func
      
      * Fix
      
      * check
      
      * FIx default arg
      
      * Fix train_mxnet mix_cpu_gpu
      
      * Make relation mix_cpu_gpu
      
      * delete some dead code
      
      * some opt for update
      
      * Fix cpu grad update
      bb6a6476
  12. 05 Jan, 2020 1 commit
    • Da Zheng's avatar
      [KG] PBG's way of constructing negative edges (#1159) · 1022d5d6
      Da Zheng authored
      * attach positive.
      
      * add neg_deg_sample.
      
      * add comment.
      
      * add neg_deg_sample for eval.
      
      * change the edge sampler.
      
      * rename edge sampler in KG.
      
      * allow specifying chunk size and negative sample size separately.
      
      * fix bugs in KG.
      
      * add check in sampler.
      
      * add more checks.
      
      * fix
      
      * add comment.
      
      * add comments.
      1022d5d6
  13. 04 Jan, 2020 1 commit
  14. 03 Jan, 2020 1 commit
  15. 02 Jan, 2020 1 commit
  16. 31 Dec, 2019 1 commit
    • Da Zheng's avatar
      Accelerate edge sampling (#1151) · 162dc19a
      Da Zheng authored
      
      
      * accel edge sampling.
      
      * measure sampling time.
      
      * attach positive.
      
      * add neg_deg_sample.
      
      * fix a minor bug.
      
      * remove unnecessary code.
      
      * Revert "add neg_deg_sample."
      
      This reverts commit 45f3c08c87e33589563ca7e6a3ec91cb1239910e.
      
      * Revert "attach positive."
      
      This reverts commit 503d7821555b69b7ccfed55ce8b87ee24fff852d.
      Co-authored-by: default avatarxiang song(charlie.song) <classicxsong@gmail.com>
      162dc19a
  17. 29 Dec, 2019 1 commit
  18. 24 Dec, 2019 1 commit
    • xiang song(charlie.song)'s avatar
      [Feature Improvement]Edge Sampler w and w/o replacement (#1116) · 41f8a162
      xiang song(charlie.song) authored
      
      
      * Add weight based edge sampler
      
      * Can run, edge weight work.
      TODO: test node weight
      
      * Fix node weight sample
      
      * Fix y
      
      * Update doc
      
      * Fix syntex
      
      * Fix
      
      * Fix GPU test for sampler
      
      * Fix test
      
      * Fix
      
      * Refactor EdgeSampler to act as class object not function that it
      can record its own private states.
      
      * clean
      
      * Fix
      
      * Fix
      
      * Fix run bug on kg app
      
      * update
      
      * update test
      
      * test
      
      * Simply python API and fix some C code
      
      * Fix
      
      * Fix
      
      * Fix syntex
      
      * Fix
      
      * Update API description
      
      * add replacement for edge sampler
      
      * Now edge sampler support replacement and no-replacement
      
      * Fix
      
      * Fix
      
      * change kg/app to use edge sampler with replacement config
      
      * Update replacement algo
      
      * Fix syntax
      
      * Update
      
      * Update
      Co-authored-by: default avatarDa Zheng <zhengda1936@gmail.com>
      41f8a162
  19. 20 Dec, 2019 1 commit
    • VoVAllen's avatar
      [Backend] TF backend (#978) · d30a69bf
      VoVAllen authored
      * tf
      
      * add builtin support
      
      * fiix
      
      * pytest
      
      * fix
      
      * fix
      
      * fix some bugs
      
      * fix selecting
      
      * fix todo
      
      * fix test
      
      * fix test fail in tf
      
      * fix
      
      * fix
      
      * fix gather row
      
      * fix gather row
      
      * log backend
      
      * fix gather row
      
      * fix gather row
      
      * fix for pytorch
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix tests
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix convert
      
      * fix
      
      * fix
      
      * fix
      
      * fix inplace
      
      * add alignment setting
      
      * add debug option
      
      * Revert "add alignment setting"
      
      This reverts commit ec63fb3506ea84fff7d447a1fbdfd1d5d1fb6110.
      
      * tf ci
      
      * fix lint
      
      * fix lint
      
      * add tfdlpack
      
      * fix type
      
      * add env
      
      * fix backend
      
      * fix
      
      * fix tests
      
      * remove one_hot
      
      * remove comment
      
      * remove comment
      
      * fix
      
      * use pip to install all
      
      * fix test
      
      * fix base
      
      * fix
      
      * fix
      
      * add skip
      
      * upgrade cmake
      
      * change version
      
      * change ci
      
      * fix
      
      * fix
      
      * fix
      
      * fix
      
      * fix seg fault
      
      * fix
      
      * fix python version
      
      * fix
      
      * try fix
      
      * fix
      
      * fix
      
      * tf takes longer time in ci
      
      * change py version
      
      * fix
      
      * fix
      
      * fix oom
      
      * change kg env
      
      * change kg env
      
      * 啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊啊
      
      * 我再也不搞各种乱七八糟环境了……
      
      * use pytest
      
      * Chang image
      d30a69bf
  20. 13 Dec, 2019 1 commit
  21. 01 Dec, 2019 2 commits
  22. 14 Nov, 2019 1 commit
    • MilkshakeForReal's avatar
      [Model] add RotatE to dgl-kg (#964) · 8b17a5c1
      MilkshakeForReal authored
      Add RotatE support for KGE (apps/kg)
      Performance Result:
      Dataset FB15k:
      Result from Paper:
      MR: 40
      MRR: 0.797
      HIT@1: 74.6
      HIT@3: 83.0
      HIT@10: 88.4
      
      Our Impl:
      MR: 39.6
      MRR: 0.725
      HIT@1: 62.8
      HIT@3: 80.2
      HIT@10: 87.5
      8b17a5c1
  23. 01 Nov, 2019 1 commit
    • xiang song(charlie.song)'s avatar
      [NN]Supporting TransR in app/kg score_func (#945) · 7f65199a
      xiang song(charlie.song) authored
      * Add TransR for kge
      
      * Now Pytorch TransR can run
      
      * Add MXNet TransR
      
      * Now mxnet can work with small dim size
      
      * Add test
      
      * Pass simple test_score
      
      * Update test with transR score func
      
      * Update RESCAL MXNet
      
      * Add missing funcs
      
      * Update init func for transR score
      
      * Revert "Update init func for transR score"
      
      This reverts commit 0798bb886095e7581f6675da5343376844ce45b9.
      
      * Update score func of TransR MXNet
      
      Make it more memory friendly and faster,
      thourgh it is still very slow and memory consuming
      
      * Update best config
      
      * Fix ramdom seed for test
      
      * Init score-func specific var
      
      * Update Readme
      7f65199a
  24. 21 Oct, 2019 1 commit
  25. 12 Oct, 2019 1 commit
  26. 11 Oct, 2019 3 commits
    • xiang song(charlie.song)'s avatar
      Fix bug of KG train.py script. (#922) · 20439e1c
      xiang song(charlie.song) authored
      It cannot work when only mxnet backend is installed.
      20439e1c
    • xiang song(charlie.song)'s avatar
      [KG] Update CI to cover Knowledge Graph (#913) · 93e3c49d
      xiang song(charlie.song) authored
      * upd
      
      * fig edgebatch edges
      
      * add test
      
      * trigger
      
      * Update README.md for pytorch PinSage example.
      
      Add noting that the PinSage model example under
      example/pytorch/recommendation only work with Python 3.6+
      as its dataset loader depends on stanfordnlp package
      which work only with Python 3.6+.
      
      * Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
      
      1. make dgl.nn.xxx frame agnostic
      2. make test.backend include dgl.nn modules
      3. modify test_edge_softmax of test/mxnet/test_nn.py and
          test/pytorch/test_nn.py work on both CPU and GPU
      
      * Fix style
      
      * Delete unused code
      
      * Make agnostic test only related to tests/backend
      
      1. clear all agnostic related code in dgl.nn
      2. make test_graph_conv agnostic to cpu/gpu
      
      * Fix code style
      
      * fix
      
      * doc
      
      * Make all test code under tests.mxnet/pytorch.test_nn.py
      work on both CPU and GPU.
      
      * Fix syntex
      
      * Remove rand
      
      * Add TAGCN nn.module and example
      
      * Now tagcn can run on CPU.
      
      * Add unitest for TGConv
      
      * Fix style
      
      * For pubmed dataset, using --lr=0.005 can achieve better acc
      
      * Fix style
      
      * Fix some descriptions
      
      * trigger
      
      * Fix doc
      
      * Add nn.TGConv and example
      
      * Fix bug
      
      * Update data in mxnet.tagcn test acc.
      
      * Fix some comments and code
      
      * delete useless code
      
      * Fix namming
      
      * Fix bug
      
      * Fix bug
      
      * Add test for mxnet TAGCov
      
      * Add test code for mxnet TAGCov
      
      * Update some docs
      
      * Fix some code
      
      * Update docs dgl.nn.mxnet
      
      * Update weight init
      
      * Fix
      
      * reproduce the bug
      
      * Fix concurrency bug reported at #755.
      Also make test_shared_mem_store.py more deterministic.
      
      * Update test_shared_mem_store.py
      
      * Update dmlc/core
      
      * Update Knowledge Graph CI with new Docker image
      
      * Remove unused line_profierx
      
      * Poke Jenkins
      
      * Update test with exit code check and simplify docker
      
      * Update Jenkinsfile to make app test a standalone stage
      
      * Update kg_test
      
      * Update Jenkinsfile
      
      * Make some KG test parallel
      
      * Update
      
      * KG MXNet does not support ComplEx
      
      * Update Jenkinsfile
      
      * Update Jenkins file
      
      * Change torch-1.2 to torch-1.2-cu92
      
      * ci
      
      * Update ubuntu_install_mxnet_cpu.sh
      
      * Update ubuntu_install_mxnet_gpu.sh
      
      * We only need to test train and eval script.
      Delete some test code
      93e3c49d
    • xiang song(charlie.song)'s avatar
      [KG] ComplEx score func for MXNet (#918) · bde75256
      xiang song(charlie.song) authored
      * upd
      
      * fig edgebatch edges
      
      * add test
      
      * trigger
      
      * Update README.md for pytorch PinSage example.
      
      Add noting that the PinSage model example under
      example/pytorch/recommendation only work with Python 3.6+
      as its dataset loader depends on stanfordnlp package
      which work only with Python 3.6+.
      
      * Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
      
      1. make dgl.nn.xxx frame agnostic
      2. make test.backend include dgl.nn modules
      3. modify test_edge_softmax of test/mxnet/test_nn.py and
          test/pytorch/test_nn.py work on both CPU and GPU
      
      * Fix style
      
      * Delete unused code
      
      * Make agnostic test only related to tests/backend
      
      1. clear all agnostic related code in dgl.nn
      2. make test_graph_conv agnostic to cpu/gpu
      
      * Fix code style
      
      * fix
      
      * doc
      
      * Make all test code under tests.mxnet/pytorch.test_nn.py
      work on both CPU and GPU.
      
      * Fix syntex
      
      * Remove rand
      
      * Add TAGCN nn.module and example
      
      * Now tagcn can run on CPU.
      
      * Add unitest for TGConv
      
      * Fix style
      
      * For pubmed dataset, using --lr=0.005 can achieve better acc
      
      * Fix style
      
      * Fix some descriptions
      
      * trigger
      
      * Fix doc
      
      * Add nn.TGConv and example
      
      * Fix bug
      
      * Update data in mxnet.tagcn test acc.
      
      * Fix some comments and code
      
      * delete useless code
      
      * Fix namming
      
      * Fix bug
      
      * Fix bug
      
      * Add test for mxnet TAGCov
      
      * Add test code for mxnet TAGCov
      
      * Update some docs
      
      * Fix some code
      
      * Update docs dgl.nn.mxnet
      
      * Update weight init
      
      * Fix
      
      * reproduce the bug
      
      * Fix concurrency bug reported at #755.
      Also make test_shared_mem_store.py more deterministic.
      
      * Update test_shared_mem_store.py
      
      * Update dmlc/core
      
      * Add complEx for mxnet
      
      * ComplEx is ready for MXNet
      bde75256
  27. 09 Oct, 2019 1 commit
  28. 08 Oct, 2019 1 commit
  29. 04 Oct, 2019 2 commits
  30. 03 Oct, 2019 2 commits
  31. 02 Oct, 2019 1 commit
    • Da Zheng's avatar
      [KG][Model] Knowledge graph embeddings (#888) · 15b951d4
      Da Zheng authored
      * upd
      
      * fig edgebatch edges
      
      * add test
      
      * trigger
      
      * Update README.md for pytorch PinSage example.
      
      Add noting that the PinSage model example under
      example/pytorch/recommendation only work with Python 3.6+
      as its dataset loader depends on stanfordnlp package
      which work only with Python 3.6+.
      
      * Provid a frame agnostic API to test nn modules on both CPU and CUDA side.
      
      1. make dgl.nn.xxx frame agnostic
      2. make test.backend include dgl.nn modules
      3. modify test_edge_softmax of test/mxnet/test_nn.py and
          test/pytorch/test_nn.py work on both CPU and GPU
      
      * Fix style
      
      * Delete unused code
      
      * Make agnostic test only related to tests/backend
      
      1. clear all agnostic related code in dgl.nn
      2. make test_graph_conv agnostic to cpu/gpu
      
      * Fix code style
      
      * fix
      
      * doc
      
      * Make all test code under tests.mxnet/pytorch.test_nn.py
      work on both CPU and GPU.
      
      * Fix syntex
      
      * Remove rand
      
      * Add TAGCN nn.module and example
      
      * Now tagcn can run on CPU.
      
      * Add unitest for TGConv
      
      * Fix style
      
      * For pubmed dataset, using --lr=0.005 can achieve better acc
      
      * Fix style
      
      * Fix some descriptions
      
      * trigger
      
      * Fix doc
      
      * Add nn.TGConv and example
      
      * Fix bug
      
      * Update data in mxnet.tagcn test acc.
      
      * Fix some comments and code
      
      * delete useless code
      
      * Fix namming
      
      * Fix bug
      
      * Fix bug
      
      * Add test for mxnet TAGCov
      
      * Add test code for mxnet TAGCov
      
      * Update some docs
      
      * Fix some code
      
      * Update docs dgl.nn.mxnet
      
      * Update weight init
      
      * Fix
      
      * init version.
      
      * change default value of regularization.
      
      * avoid specifying adversarial_temperature
      
      * use default eval_interval.
      
      * remove original model.
      
      * remove optimizer.
      
      * set default value of num_proc
      
      * set default value of log_interval.
      
      * don't need to set neg_sample_size_valid.
      
      * remove unused code.
      
      * use uni_weight by default.
      
      * unify model.
      
      * rename model.
      
      * remove unnecessary data sampler.
      
      * remove the code for checkpoint.
      
      * fix eval.
      
      * raise exception in invalid arguments.
      
      * remove RowAdagrad.
      
      * remove unsupported score function for now.
      
      * Fix bugs of kg
      Update README
      
      * Update Readme for mxnet distmult
      
      * Update README.md
      
      * Update README.md
      
      * revert changes on dmlc
      
      * add tests.
      
      * update CI.
      
      * add tests script.
      
      * reorder tests in CI.
      
      * measure performance.
      
      * add results on wn18
      
      * remove some code.
      
      * rename the training script.
      
      * new results on TransE.
      
      * remove --train.
      
      * add format.
      
      * fix.
      
      * use EdgeSubgraph.
      
      * create PBGNegEdgeSubgraph to simplify the code.
      
      * fix test
      
      * fix CI.
      
      * run nose for unit tests.
      
      * remove unused code in dataset.
      
      * change argument to save embeddings.
      
      * test training and eval scripts in CI.
      
      * check Pytorch version.
      
      * fix a minor problem in config.
      
      * fix a minor bug.
      
      * fix readme.
      
      * Update README.md
      
      * Update README.md
      
      * Update README.md
      15b951d4