"tests/test_modeling_megatron_bert.py" did not exist on "7809eb82ae0341b7a02b1ce7ab7d6d551e9855d9"
-
Stas Bekman authored
After experimenting with different number of workers https://github.com/huggingface/transformers/issues/9496#issuecomment-758145868 4-5 workers seems to be the most optimal - let's go with 4 as surely we wouldn't find a cpu with less cores these days. Fixes part of https://github.com/huggingface/transformers/issues/9496 @sgugger
0ecbb698
