Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "d094d8d9ec5c2b26515659933154b5d5452beb8b"
Unverified Commit 5b004001 authored by Nicolas Patry's avatar Nicolas Patry Committed by GitHub
Browse files

Adding `Perceiver` to `AutoTokenizer`. (#14711)

parent 59d684fa
Show whitespace changes
Inline Side-by-side
Showing with 7 additions and 0 deletions
src/transformers/models/auto/tokenization_auto.py
View file @ 5b004001
...@@ -223,6 +223,13 @@ else: ...@@ -223,6 +223,13 @@ else:
"CLIPTokenizerFast" if is_tokenizers_available() else None, "CLIPTokenizerFast" if is_tokenizers_available() else None,
), ),
), ),
(
"perceiver",
(
"PerceiverTokenizer",
None,
),
),
] ]
) )
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment