official/transformer/utils/tokenizer.py · e7b4d364de5dc9d66d23085a5c52b5d7631576a7 · ModelZoo / ResNet50_tensorflow

saberkun authored Jun 10, 2019

252534787  by hongkuny<hongkuny@google.com>:

    Transformer vocab fix to strip correctly in py2

--

PiperOrigin-RevId: 252534787

e7b4d364

tokenizer.py 22.7 KB