Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "ffceef2042d5a1f2a2d70c8a0606551147dd6f8d"
Unverified Commit 7498db06 authored by regisss's avatar regisss Committed by GitHub
Browse files

Replace BloomTokenizer by BloomTokenizerFast in doc (#18005)

parent 3cfdefaa
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
src/transformers/models/bloom/modeling_bloom.py
View file @ 7498db06
...@@ -38,7 +38,7 @@ logger = logging.get_logger(__name__) ...@@ -38,7 +38,7 @@ logger = logging.get_logger(__name__)
_CHECKPOINT_FOR_DOC = "bigscience/Bloom" _CHECKPOINT_FOR_DOC = "bigscience/Bloom"
_CONFIG_FOR_DOC = "BloomConfig" _CONFIG_FOR_DOC = "BloomConfig"
_TOKENIZER_FOR_DOC = "BloomTokenizer" _TOKENIZER_FOR_DOC = "BloomTokenizerFast"
BLOOM_PRETRAINED_MODEL_ARCHIVE_LIST = [ BLOOM_PRETRAINED_MODEL_ARCHIVE_LIST = [
"bigscience/bigscience-small-testing", "bigscience/bigscience-small-testing",
...@@ -626,7 +626,7 @@ BLOOM_INPUTS_DOCSTRING = r""" ...@@ -626,7 +626,7 @@ BLOOM_INPUTS_DOCSTRING = r"""
If `past_key_values` is used, only `input_ids` that do not have their past calculated should be passed as If `past_key_values` is used, only `input_ids` that do not have their past calculated should be passed as
`input_ids`. `input_ids`.
Indices can be obtained using [`BloomTokenizer`]. See [`PreTrainedTokenizer.encode`] and Indices can be obtained using [`BloomTokenizerFast`]. See [`PreTrainedTokenizer.encode`] and
[`PreTrainedTokenizer.__call__`] for details. [`PreTrainedTokenizer.__call__`] for details.
[What are input IDs?](../glossary#input-ids) [What are input IDs?](../glossary#input-ids)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment