Skip to content

GitLab

"tests/plbart/test_modeling_plbart.py" did not exist on "eef66035a28b935b7823c9a7ddc8c569e077ce11"
Switch branch/tag
Find file Normal viewHistoryPermalink
custom_tokenization.py 88 Bytes
Newer Older
Sylvain Gugger's avatar
Save code of registered custom models (#15379)  
Sylvain Gugger committed
1
2
3
4
5 
from transformers import BertTokenizer


class CustomTokenizer(BertTokenizer):
    pass