Commits · 7e2ed9f8a84e63b8f647c3b779181d5489499d46 · OpenDAS / dgl

21 Aug, 2022 1 commit
- Let distributed training launch script report error when any trainer or kvserver fails. (#4437) · ee672c0b
  xiang song(charlie.song) authored Aug 21, 2022
```
* Collect error reports

* update

* fix
Co-authored-by: root <root@ip-10-0-80-128.ec2.internal>
```
  ee672c0b
14 Jun, 2022 1 commit
- [Dist] master port should be fixed for all trainers (#4108) · 9501ed6a
  Rhett Ying authored Jun 14, 2022
```
* [Dist] master port should be fixed for all trainers

* add tests for tools/launch.py
```
  9501ed6a
09 Jun, 2022 1 commit
- [Dist] avoid busy ssh connection (#4096) · 966d1aa8
  Rhett Ying authored Jun 09, 2022
  
  966d1aa8
09 Feb, 2022 1 commit

[Feature] Launch Long Live Servers and Multiple Client Groups (#3688) · fcd8ed9a

Rhett Ying authored Feb 09, 2022

* enable to launch multiple client groups sequentially

* launch simultaneously is enabled

* refine docstring

* revert unnecessary change

* [DOC] add doc for long live server

* refine

* refine doc

* refine doc

fcd8ed9a

23 Sep, 2021 1 commit

[Distributed] Allow user to pass-in extra env parameters when launching a... · 179d6aab

xiang song(charlie.song) authored Sep 23, 2021


[Distributed] Allow user to pass-in extra env parameters when launching a distributed training task. (#3375)

* Allow user to pass-in extra env parameters when launching a distributed training task.

* Update

* upd
Co-authored-by: xiangsx <xiangsx@ip-10-3-59-214.eu-west-1.compute.internal>

179d6aab

14 Sep, 2021 1 commit

[Bugfix] And PYTHONPATH in server launch. (#3352) · ad61a9a5

xiang song(charlie.song) authored Sep 14, 2021



* put PYTHONPATH in server launch

* remove prints
Co-authored-by: xiangsx <xiangsx@ip-10-3-59-214.eu-west-1.compute.internal>

ad61a9a5

17 Aug, 2021 1 commit

[Tools] In `tools/launch.py`, correctly pass all DGL client/server env vars if... · ac01e880

Eric Kim authored Aug 16, 2021

[Tools] In `tools/launch.py`, correctly pass all DGL client/server env vars if udf is a multi-command (#3245)

* Correctly pass all DGL client/server env vars if udf is a multi-command

* Refactor to use wrap_cmd_with_local_envvars() helper fn

ac01e880

02 Aug, 2021 1 commit
- [Tools] Refactor tools/launch.py to handle more python binary names (#3205) · c40bbf4f
  Eric Kim authored Aug 02, 2021
```
* Refactors torch dist launcher udf-wrap code to handle more python versions

* minor changes
```
  c40bbf4f
30 Jul, 2021 1 commit
- [Tools] Adds --ssh_username to the dist launcher (tools/launch.py) (#3202) · efd0fc6c
  Eric Kim authored Jul 30, 2021
  
  efd0fc6c
26 May, 2021 1 commit

[Distributed] Specify the graph format for distributed training (#2948) · 18dbaebe

Da Zheng authored May 26, 2021



* explicitly set the graph format.

* fix.

* fix.

* fix launch script.

* fix readme.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>

18dbaebe

01 May, 2021 1 commit

[Distributed] Kill training jobs in distributed training (#2881) · 2d372e35

Da Zheng authored May 01, 2021



* kill training jobs.

* update.

* fix.
Co-authored-by: Zheng <dzzhen@3c22fba32af5.ant.amazon.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-71-112.ec2.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-73-81.ec2.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

2d372e35

08 Apr, 2021 1 commit

[Distributed] Fix a bug in multiprocessing sampling. (#2826) · bfbbefa7

Da Zheng authored Apr 08, 2021


Co-authored-by: Ubuntu <ubuntu@ip-172-31-73-81.ec2.internal>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

bfbbefa7

04 Apr, 2021 1 commit
- [Distributed] Automatically setting the number of OMP threads for trainers (#2812) · 86229d42
  Da Zheng authored Apr 04, 2021
```
* set omp thread.

* add comment.

* fix.
```
  86229d42
30 Mar, 2021 1 commit

[Distributed] Simplify distributed API (#2775) · e36c5db6

Da Zheng authored Mar 29, 2021



* remove num_workers.

* remove num_workers.

* remove num_workers.

* remove num-servers.

* update error message.

* update docstring.

* fix docs.

* fix tests.

* fix test.

* fix.

* print messages in test.

* fix.

* fix test.

* fix.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-9-132.us-west-1.compute.internal>

e36c5db6

27 Aug, 2020 1 commit
- [Distributed] Check num_workers and num_samplers (#2108) · 4327d712
  Chao Ma authored Aug 27, 2020
```
* check num_workers

* update

* update

* update

* update

* update

* update
```
  4327d712
12 Aug, 2020 1 commit
- [Distributed] Fix all arguments to the format of xx_xxx (#2005) · f5d8fa84
  Chao Ma authored Aug 12, 2020
```
* update

* update
```
  f5d8fa84
11 Aug, 2020 2 commits

[Distributed] Move server start code to initialize. (#2002) · 4efa3320
Da Zheng authored Aug 11, 2020
```
* move server start code to initialize.

* fix.

* fix lint.

* fix examples.

* add more checks.
```
4efa3320

[Distributed] Remove server_count from ip_config.txt (#1985) · d340ea3a

Chao Ma authored Aug 11, 2020



* remove server_count from ip_config.txt

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update dist_context.py

* fix lint.

* make it work for multiple spaces.

* update ip_config.txt.

* fix examples.

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* udpate

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

d340ea3a

10 Aug, 2020 1 commit

[Distributed] Fix standalone (#1974) · ee30b2aa

Da Zheng authored Aug 10, 2020



* fix tests.

* fix.

* remove a test.

* make code work in the standalone mode.

* fix example.

* more fix.

* make DistDataloader work with num_workers=0

* fix DistDataloader tests.

* fix.

* fix lint.

* fix cleanup.

* fix test

* remove unnecessary code.

* remove tests.

* fix.

* fix.

* fix.

* fix example

* fix.

* fix.

* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

ee30b2aa

09 Aug, 2020 1 commit

[Distributed] Set the number of threads correctly to speed up (#1976) · b9ef70e5

Da Zheng authored Aug 08, 2020

* temp fix omp.

* set server threads.

* add CAPI to set up OMP threads.

* fix.

* fix.

* update namesapce.

* set cpi properly.

* allow to config num worker threads.

* set #threads.

* fix.

b9ef70e5

08 Aug, 2020 1 commit
- [Distributed] Fix the launch script. (#1977) · f0fbbc16
  Da Zheng authored Aug 08, 2020
```
* update launch script

* check the correctness of launch script.

* fix.
```
  f0fbbc16
31 Jul, 2020 1 commit

[Distributed] add copy_partitions.py (#1866) · 4be4b134

Da Zheng authored Jul 31, 2020



* fix bugs.

* eval on both vaidation and testing.

* add script.

* update.

* update launch.

* make train_dist.py independent.

* update readme.

* update readme.

* update readme.

* update readme.

* generate undirected graph.

* rename conf_file to part_config

* use rsync

* make train_dist independent.
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-115.us-west-2.compute.internal>
Co-authored-by: xiang song(charlie.song) <classicxsong@gmail.com>

4be4b134

27 Jul, 2020 1 commit
- [Distributed] Small fix on launch script (#1867) · bcb988bd
  Chao Ma authored Jul 27, 2020
```
* update

* update

* update

* update
```
  bcb988bd
17 Jul, 2020 1 commit

fix launch. (#1822) · 7645c660

Da Zheng authored Jul 17, 2020


Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

7645c660

16 Jul, 2020 1 commit

[Distributed] Distributed launching script (#1772) · ca9d3216

Chao Ma authored Jul 17, 2020



* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix launch script.
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

ca9d3216