Let inputs of fast tokenizers be tuples as well as lists (#19898)
* Let inputs of fast tokenizers be tuples as well as lists * Update src/transformers/tokenization_utils_fast.py Co-authored-by:Lysandre Debut <lysandre.debut@reseau.eseo.fr> * Style Co-authored-by:
Lysandre Debut <lysandre.debut@reseau.eseo.fr>
Showing
Please register or sign in to comment