Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Arthur's avatar
    Fix bloom add prefix space (#25652) · e20fab0b
    Arthur authored 
    * properly support Sequence of pretokenizers

* actual fix

* make sure the fix works. Tests are not working for sure!

* hacky way

* add TODO

* update

* add a todo

* nits

* rename test

* nits

* rename test
    e20fab0b
test_tokenization_bloom.py 6.18 KB