Unverified Commit ef47d4f8 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

[AutoTokenizer] Fix incorrect from pretrained (#14900)

parent 8f2cc1c3
......@@ -350,7 +350,7 @@ def get_tokenizer_config(
use_auth_token=use_auth_token,
)
except EnvironmentError:
except (EnvironmentError, ValueError):
logger.info("Could not locate the tokenizer configuration file, will try to use the model config instead.")
return {}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment