tests/test_data_collator.py · 27b1516d32b691533fc497e7ee4ceb88c39cdfdf · chenpangpang / transformers

minimal fixes to run DataCollatorForWholeWordMask with return_tensors="np" and... · 27b1516d

Dean Wyatte authored Nov 03, 2021

minimal fixes to run DataCollatorForWholeWordMask with return_tensors="np" and return_tensors="tf" (#13891)

* minimal fixes to run DataCollatorForWholeWordMask with return_tensors="np" and return_tensors="tf"

* more consinstent implementation for numpy_mask_tokens

27b1516d

test_data_collator.py 40.6 KB

Replace test_data_collator.py