Fix for #3865. PretrainedTokenizer mapped " do not" into " don't" when...
Fix for #3865. PretrainedTokenizer mapped " do not" into " don't" when .decode(...) is called. Removed the " do not" --> " don't" mapping from clean_up_tokenization(...). (#4024)
Showing
Please register or sign in to comment