Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • SaulLu's avatar
    add warning to let the user know that the `__call__` method is faster than... · 6667b0d7
    SaulLu authored 
    add warning to let the user know that the `__call__` method is faster than `encode` + `pad` for a fast tokenizer (#18693)

* add warning to let the user know that the  method is slower that  for a fast tokenizer

* user warnings

* fix layoutlmv2

* fix layout*

* change warnings into logger.warning
    6667b0d7
test_tokenization_common.py 202 KB