tests/distributed/test_dist_graph_store.py · b13092172db668c26da487e8f782c7cf1caa92a6 · OpenDAS / dgl

[Dist] Reduce peak memory in DistDGL (#4687) · b1309217

Rhett Ying authored Oct 17, 2022

* [Dist] Reduce peak memory in DistDGL: avoid validation, release memory once loaded

* remove orig_id from ndata/edata for partition_graph()

* delete orig_id from ndata/edata in dist part pipeline

* reduce dtype size and format before saving graphs

* fix lint

* ETYPE requires to be int32/64 for CSRSortByTag

* fix test failure

* refine

b1309217

test_dist_graph_store.py 34.8 KB

Replace test_dist_graph_store.py