- 10 Nov, 2020 1 commit
-
-
Tom Birch authored
Adds support for: * Reused layers (e.g. for weight sharing) * Lazily-constructed layers * Single-process control via PipeRPCWrapper * PipelineStyle.AsyncScheudle, which lays the foundation for asynchronous pipeline work by introducing an event loop for each rank/worker to process either activations or gradients as they arrive Also added examples for multi-process and PipeRPCWrapper
-
- 21 Oct, 2020 1 commit
-
-
Vittorio Caggiano authored
* wip_example * [wip]mnist_pipe_example * [wip]mnist_pipe_example * [wip]mnist_pipe_example * [wip]mnist_pipe_example * [wip]mnist_oss_example * working prototype * added tutorial script * update tutorial * Update mnist_test_oss.py * Update mnist_test_oss.py * Update mnist_test_oss.py * Update mnist_test_pipe.py * Update tutorial_oss.py * Update tutorial_pipe.py * Update tutorial_pipe.py * Update mnist_test_oss.py * Update tutorial_pipe.py * Update mnist_test_pipe.py * Update tutorial_pipe.py * fix black * fix flacke8 * general fixes * add example oss+pipe * fix isort * Update mnist_test_pipe.py * fix black Co-authored-by:Vittorio Caggiano <caggiano@devfair0253.h2.fair>
-