• Tom Birch's avatar
    Multi-process pipe (#90) · 63f7796a
    Tom Birch authored
    Adds support for distributing pipeline stages across multiple processes (and therefore multiple machines)
    * Adds a style argument to the Pipe constructor, defaulting to PipelineStyle.SingleProcess, but also supporting PipelineStyle.MultiProcess
    * Added support for lazy construction of modules (see lazy_construction for an example)
    * Added two implementations of inter-process communication: one based on rpc with globally visible queues, one based on send/recv
    * Copied all the relevant tests from tests/pipe to tests/pipe_process and modified them to exercise PipelineStyle.MultiProcess
    63f7796a
run_mpi_tests.sh 113 Bytes