• Davide Caroselli's avatar
    FIX: '--user-dir' on multi-gpu (#449) · 7853818c
    Davide Caroselli authored
    Summary:
    On a multi-gpu training scenario, the `train.py` script spawns new processes with `torch.multiprocessing.spawn`. Unfortunately those child processes don't inherit the modules imported with `--user-dir`.
    
    This pull request fixes this problem: custom module import in now explicit on every `main()` function.
    Pull Request resolved: https://github.com/pytorch/fairseq/pull/449
    
    Differential Revision: D13676922
    
    Pulled By: myleott
    
    fbshipit-source-id: 520358d66155697885b878a37e7d0484bddbc1c6
    7853818c
train.py 14.9 KB