examples/roberta/multiprocessing_bpe_encoder.py · 45f23f66bec3063cb20ffae8c6a9084e45669aba · OpenDAS / Fairseq

Add more details for bulk BPE encoding · 45f23f66

Myle Ott authored Aug 01, 2019

Summary: Pull Request resolved: https://github.com/fairinternal/fairseq-py/pull/793

Differential Revision: D16603930

Pulled By: myleott

fbshipit-source-id: b302db3743db4f36c14fb0dc7f3456fe8a0079dd

45f23f66

multiprocessing_bpe_encoder.py 3.67 KB

Replace multiprocessing_bpe_encoder.py