Commits · 0f3223310d0f0e7dd837422c82b135d8a35aead0 · OpenDAS / dgl

09 Jun, 2023 1 commit
- [DistDGL] remove tensorpipe from python APIs (#5848) · 0f322331
  Rhett Ying authored Jun 09, 2023
  
  0f322331
19 Feb, 2023 1 commit

[Misc] Auto-reformat test/. (#5324) · f0759a96

Hongzhi (Steve), Chen authored Feb 19, 2023



* auto-format-test

* more

* remove

---------
Co-authored-by: Ubuntu <ubuntu@ip-172-31-28-63.ap-northeast-1.compute.internal>

f0759a96

10 Oct, 2022 1 commit
- [Misc] Black auto fix. (#4694) · 89a4cc4d
  Hongzhi (Steve), Chen authored Oct 11, 2022
```
Co-authored-by: Steve <ubuntu@ip-172-31-34-29.ap-northeast-1.compute.internal>
```
  89a4cc4d
16 Jun, 2022 1 commit
- [Dist] set socket as default backend for RPC (#4120) · b258729b
  Rhett Ying authored Jun 16, 2022
```
* [Dist] set socket as default backend for RPC

* add tests both for socket and tensorpipe
```
  b258729b
09 Jun, 2022 1 commit
- disable multiple groups tests due to random failure in CI (#4101) · abcc9cce
  Rhett Ying authored Jun 09, 2022
  
  abcc9cce
08 Jun, 2022 1 commit

[Dist] enable time out when fetching msg (#4043) · cac3720b

Rhett Ying authored Jun 08, 2022

* [ist] enable time out when fetching msg

* fix lint error

* minor refinements

* improve minor log

* fix dist test

* fix timeout issue in tensorpipe

cac3720b

11 May, 2022 1 commit

[Dist] Enable maximum try times for socket backend via DGL_DIST_MAX_T… (#3977) · 22e218d3

Rhett Ying authored May 11, 2022

* [Dist] Enable maximum try times for socket backend via DGL_DIST_MAX_TRY_TIMES

* reset env before/after test

* print log for info when trying to connect

* fix

* print log in python instead of cpp

22e218d3

27 Apr, 2022 1 commit

[Feature] enable socket net_type for rpc (#3951) · 37be02a4

Rhett Ying authored Apr 28, 2022

* [Feature] enable socket net_type for rpc

* fix lint

* fix lint

* fix build issue on windows

* fix test failure on windows

* fix test failure

* fix cpp unit test failure

* net_type blocking max_try_times

* fix other comments

* fix lint

* fix comment

* fix lint

* fix cpp

37be02a4

24 Mar, 2022 1 commit
- [BugFix] send rpc messages blockingly in case of congestion (#3867) · e9fd65e9
  Rhett Ying authored Mar 24, 2022
```
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
```
  e9fd65e9
28 Jan, 2022 1 commit
- [Fix] reduce concurrent client/server processes to avoid port already in use (#3697) · bf5497a2
  Rhett Ying authored Jan 28, 2022
  
  bf5497a2
26 Jan, 2022 1 commit

[Feature] long live server for multiple client groups (#3645) · 02e4cd8b

Rhett Ying authored Jan 26, 2022

* [Feature] long live server for multiple client groups

* generate globally unique name for DistTensor within DGL automatically

02e4cd8b

19 Jan, 2022 2 commits

Fix test failure in multithread rpc test (#3660) · 51651eca
Jinjing Zhou authored Jan 19, 2022

51651eca

[Fix] reduce error msg, refine fetch logic of available ports (#3658) · e4cb4a37

Rhett Ying authored Jan 19, 2022

* [Fix] reduce error msg, refine fetch logic of available ports

* un-initialize client before sending shutdown request

* fix import error

* print connect failure log only in debug mode

* enable DMLC_LOG_DEBUG=1 in CI

e4cb4a37

11 Jan, 2022 1 commit

[Feature][Dist] change TP::Receiver/TP::Sender for multiple connections (#3574) · 37467e25

Rhett Ying authored Jan 11, 2022



* [Feature] enable TP::Receiver wait for any numbers of senders

* fix random unit test failure

* avoid endless future wait

* fix unit test failure

* fix seg fault when finalize wait in receiver

* [Feature] refactor sender connect logic and remove unnecessary sleeps in unit tests

* fix lint

* release RPCContext resources before process exits

* [Debug] TPReceiver wait start log

* [Debug] add log in get port

* [Debug] add log

* [ReDebug] revert time sleep in unit tests

* [Debug] remove sleep for test_distri,test_mp

* [debug] add more log

* [debug] add listen_booted_ flag

* [debug] restore commented code for queue

* [debug] sleep more in rpc_client

* restore change in tests

* Revert "restore change in tests"

This reverts commit 41a18926d181ec2517069389bfc41de2cc949280.

* Revert "[debug] sleep more in rpc_client"

This reverts commit a908e758eabca0a6ce62eb2e59baea02a840ac67.

* Revert "[debug] restore commented code for queue"

This reverts commit d3f993b3746e6bb6e2cc2f90204dd7e9461c6301.

* Revert "[debug] add listen_booted_ flag"

This reverts commit 244b2167d94942ff2a0acec8823b974975e52580.

* Revert "[debug] add more log"

This reverts commit 4b78447b0a575a824821dc7e25cca2246e6e30e2.

* Revert "[Debug] remove sleep for test_distri,test_mp"

This reverts commit e1df1aadcc8b1c2a0013ed77322ac391a8807612.

* remove debug code

* revert unnecessary change

* revert unnecessary changes

* always reset RPCContext when get started and reset all data

* remove time.sleep in dist tests

* fix lint

* reset envs before each dist test

* reset env properly

* add time sleep when start each server

* sleep for a while when boot server

* replace wait_thread with callback

* fix lint

* add dglconnect handshake check
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

37467e25

06 Dec, 2021 1 commit

[RPC] Use tensorpipe for rpc communication (#3335) · a3ce780d

Jinjing Zhou authored Dec 06, 2021

* doesn't know whether works

* add change

* fix

* fix

* fix

* remove

* revert

* lint

* lint

* fix

* revert

* lint

* fix

* only build rpc on linux

* lint

* lint

* fix build on windows

* fix windows

* remove old test

* fix cmake

* Revert "remove old test"

This reverts commit f1ea75c777c34cdc1f08c0589676ba6aee1feb29.

* fix windows

* fix

* fix

* fix indent

* fix indent

* address comment

* fix

* fix

* fix

* fix

* fix

* lint

* fix indent

* fix lint

* add introduction

* fix

* lint

* lint

* add more logs

* fix

* update xbyak for C++14 with gcc5

* Remove channels

* fix

* add test script

* fix

* remove unused file

* fix lint

* add timeout

a3ce780d

11 Aug, 2020 1 commit

[Distributed] Remove server_count from ip_config.txt (#1985) · d340ea3a

Chao Ma authored Aug 11, 2020



* remove server_count from ip_config.txt

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* Update dist_context.py

* fix lint.

* make it work for multiple spaces.

* update ip_config.txt.

* fix examples.

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* udpate

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

d340ea3a

10 Aug, 2020 1 commit

[Distributed] Fix standalone (#1974) · ee30b2aa

Da Zheng authored Aug 10, 2020



* fix tests.

* fix.

* remove a test.

* make code work in the standalone mode.

* fix example.

* more fix.

* make DistDataloader work with num_workers=0

* fix DistDataloader tests.

* fix.

* fix lint.

* fix cleanup.

* fix test

* remove unnecessary code.

* remove tests.

* fix.

* fix.

* fix.

* fix example

* fix.

* fix.

* fix launch script.
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>
Co-authored-by: Ubuntu <ubuntu@ip-172-31-19-1.us-west-2.compute.internal>

ee30b2aa

30 Jul, 2020 1 commit

[KVStore] Support group barrier (#1880) · 5b515cf6

Chao Ma authored Jul 30, 2020



* udpate

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* update

* update

* update

* udpate

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

5b515cf6

20 Jul, 2020 1 commit

[RPC] Rpc exit with explicit invocation (#1825) · 5c92f6c2

Chao Ma authored Jul 20, 2020

* exit client

* update

* update

* update

* update

* update

* update

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

5c92f6c2

07 Jul, 2020 1 commit
- [RPC] Client will retry connection until the server starts. (#1758) · bdc1e649
  Chao Ma authored Jul 07, 2020
```
* update

* update

* update
```
  bdc1e649
29 Jun, 2020 1 commit

[rpc] Add num_clients and sort client ID by machine-id (#1713) · dd8d5289

Chao Ma authored Jun 29, 2020



* add num_clients to kvstore

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* update

* update

* add test

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

dd8d5289

18 Jun, 2020 1 commit

[RPC] Sampling over RPC (#1616) · fb248b67

Jinjing Zhou authored Jun 19, 2020



* fix

* test1111

* 111

* 111

* fff

* lint

* 111

* lint

* lint

* 111

* fijx

* 111

* fix

* 111

* commit

* 111

* 111

* lint

* fix typo

* fix

* lint

* fix

* 111

* support mxnet

* support mxnet

* lint

* remove print

* fix

* fix test.

* fix test.

* fix test.

* try to fix an undetermistic error.
Co-authored-by: Chao Ma <mctt90@gmail.com>
Co-authored-by: Da Zheng <zhengda1936@gmail.com>

fb248b67

11 Jun, 2020 3 commits
- [CI] Use spawn in unittest instead of fork (#1627) · 77006db2
  Jinjing Zhou authored Jun 11, 2020
```
* update

* update

* update

* update

* update

* update

* fix ci using spawn
Co-authored-by: aksnzhy <mctt90@gmail.com>
```
  77006db2
- [rpc] Move test_rpc.py to distributed and use dynamic port binding (#1623) · 0c313e51
  Chao Ma authored Jun 11, 2020
```
* update

* update

* update

* update

* update

* update

* update

* update
```
  0c313e51
- [RPC] Add send_request_to_machine() and remote_call_to_machine() (#1619) · a67ba946
  Chao Ma authored Jun 11, 2020
```
* add send_request_to_machine()

* update

* update

* update

* update

* update

* update

* fix lint

* update
```
  a67ba946
04 Jun, 2020 1 commit

[KVStore] Re-write kvstore using DGL RPC infrastructure (#1569) · 64f49703

Chao Ma authored Jun 04, 2020

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update init_data

* update server_state

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* debug init_data

* update

* update

* update

* update

* update

* update

* test get_meta_data

* update

* update

* update

* update

* update

* debug push

* update

* update

* update

* update

* update

* update

* update

* update

* update

* use F.reverse_data_type_dict

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* update

* fix lint

* update

* fix lint

* update

* update

* update

* update

* fix test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* set random seed

* update

64f49703

22 May, 2020 1 commit

[RPC] New RPC infrastructure. (#1549) · 3e696922

Chao Ma authored May 22, 2020



* WIP: rpc components

* client & server

* move network package to rpc

* fix include

* fix compile

* c api

* wip: test

* add basic tests

* missing file

* [RPC] Zero copy serializer (#1517)

* zerocopy serialization

* add test for HeteroGraph

* fix lint

* remove unnecessary codes

* add comment

* lint

* lint

* disable pylint for now

* add include for win

* windows guard

* lint

* lint

* skip test on windows

* refactor

* add comment

* fix

* comment

* 1111

* fix

* Update Jenkinsfile

* [RPC] Implementation of RPC infra (#1544)

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* remove client.cc and server.cc

* fix lint

* update

* update

* fix linr

* update

* fix lint

* update

* update

* update

* update

* update

* update

* update test

* update

* update test

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update comment

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* fix lint

* fix lint

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update

* update
Co-authored-by: Minjie Wang <wmjlyjemaine@gmail.com>
Co-authored-by: Jinjing Zhou <VoVAllen@users.noreply.github.com>

3e696922