-
Xutai Ma authored
Summary: Add the max-token-valid option. Sometime a separate max batch tokens for validation may be helpful, for example when there is a long sequence in validation set thats larger than max_tokens (it's rare in MT but could happen in ASR or AST). Reviewed By: myleott Differential Revision: D16076951 fbshipit-source-id: ae7f4218594580b9450a8196d7afa1e7e2018aee
bccfddbb
