Unverified Commit 6336a7f7 authored by Yih-Dar's avatar Yih-Dar Committed by GitHub
Browse files

Log a warning in `TransfoXLTokenizer.__init__` (#27721)



* log

* log

---------
Co-authored-by: default avatarydshieh <ydshieh@users.noreply.github.com>
parent 93170298
...@@ -181,6 +181,12 @@ class TransfoXLTokenizer(PreTrainedTokenizer): ...@@ -181,6 +181,12 @@ class TransfoXLTokenizer(PreTrainedTokenizer):
language="en", language="en",
**kwargs, **kwargs,
): ):
logger.error(
"`TransfoXL` was deprecated due to security issues linked to `pickle.load` in `TransfoXLTokenizer`. "
"See more details on this model's documentation page: "
"`https://github.com/huggingface/transformers/blob/main/docs/source/en/model_doc/transfo-xl.md`."
)
requires_backends(self, "sacremoses") requires_backends(self, "sacremoses")
if special is None: if special is None:
special = [] special = []
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment