Commits · 18dbaebebca7f236355ea44dd943b3e10b92901d · OpenDAS / dgl

26 May, 2021 1 commit

[Distributed] Specify the graph format for distributed training (#2948) · 18dbaebe

Da Zheng authored May 26, 2021



* explicitly set the graph format.

* fix.

* fix.

* fix launch script.

* fix readme.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>

18dbaebe

01 May, 2021 1 commit

[Distributed] Kill training jobs in distributed training (#2881) · 2d372e35

Da Zheng authored May 01, 2021



* kill training jobs.

* update.

* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-73-81.ec2.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

2d372e35

08 Apr, 2021 1 commit

[Distributed] Fix a bug in multiprocessing sampling. (#2826) · bfbbefa7

Da Zheng authored Apr 08, 2021


Co-authored-by: Ubuntu <ubuntu@ip-172-31-73-81.ec2.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

bfbbefa7

04 Apr, 2021 1 commit
- [Distributed] Automatically setting the number of OMP threads for trainers (#2812) · 86229d42
  Da Zheng authored Apr 04, 2021
```
* set omp thread.

* add comment.

* fix.
```
  86229d42
30 Mar, 2021 1 commit

[Distributed] Simplify distributed API (#2775) · e36c5db6

Da Zheng authored Mar 29, 2021



* remove num_workers.

* remove num_workers.

* remove num_workers.

* remove num-servers.

* update error message.

* update docstring.

* fix docs.

* fix tests.

* fix test.

* fix.

* print messages in test.

* fix.

* fix test.

* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>

e36c5db6

27 Aug, 2020 1 commit
- [Distributed] Check num_workers and num_samplers (#2108) · 4327d712
  Chao Ma authored Aug 27, 2020
```
* check num_workers

* update

* update

* update

* update

* update

* update
```
  4327d712
12 Aug, 2020 1 commit
- [Distributed] Fix all arguments to the format of xx_xxx (#2005) · f5d8fa84
  Chao Ma authored Aug 12, 2020
```
* update

* update
```
  f5d8fa84
11 Aug, 2020 2 commits

[Distributed] Move server start code to initialize. (#2002) · 4efa3320
Da Zheng authored Aug 11, 2020
```
* move server start code to initialize.

* fix.

* fix lint.

* fix examples.

* add more checks.
```
4efa3320

[Distributed] Remove server_count from ip_config.txt (#1985) · d340ea3a

Chao Ma authored Aug 11, 2020



* remove server_count from ip_config.txt

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update dist_context.py

* fix lint.

* make it work for multiple spaces.

* update ip_config.txt.

* fix examples.

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* udpate

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

d340ea3a

10 Aug, 2020 1 commit

[Distributed] Fix standalone (#1974) · ee30b2aa

Da Zheng authored Aug 10, 2020



* fix tests.

* fix.

* remove a test.

* make code work in the standalone mode.

* fix example.

* more fix.

* make DistDataloader work with num_workers=0

* fix DistDataloader tests.

* fix.

* fix lint.

* fix cleanup.

* fix test

* remove unnecessary code.

* remove tests.

* fix.

* fix.

* fix.

* fix example

* fix.

* fix.

* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

ee30b2aa

09 Aug, 2020 1 commit

[Distributed] Set the number of threads correctly to speed up (#1976) · b9ef70e5

Da Zheng authored Aug 08, 2020

* temp fix omp.

* set server threads.

* add CAPI to set up OMP threads.

* fix.

* fix.

* update namesapce.

* set cpi properly.

* allow to config num worker threads.

* set #threads.

* fix.

b9ef70e5

08 Aug, 2020 1 commit
- [Distributed] Fix the launch script. (#1977) · f0fbbc16
  Da Zheng authored Aug 08, 2020
```
* update launch script

* check the correctness of launch script.

* fix.
```
  f0fbbc16
31 Jul, 2020 1 commit

[Distributed] add copy_partitions.py (#1866) · 4be4b134

Da Zheng authored Jul 31, 2020



* fix bugs.

* eval on both vaidation and testing.

* add script.

* update.

* update launch.

* make train_dist.py independent.

* update readme.

* update readme.

* update readme.

* update readme.

* generate undirected graph.

* rename conf_file to part_config

* use rsync

* make train_dist independent.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

4be4b134

27 Jul, 2020 1 commit
- [Distributed] Small fix on launch script (#1867) · bcb988bd
  Chao Ma authored Jul 27, 2020
```
* update

* update

* update

* update
```
  bcb988bd
17 Jul, 2020 1 commit

fix launch. (#1822) · 7645c660

Da Zheng authored Jul 17, 2020


Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

7645c660

16 Jul, 2020 1 commit

[Distributed] Distributed launching script (#1772) · ca9d3216

Chao Ma authored Jul 17, 2020



* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix launch script.
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

ca9d3216