Unverified Commit eae6d8d1 authored by Sebastian's avatar Sebastian Committed by GitHub
Browse files

Update tokenizers to 0.8.1.rc to fix Mac OS X issues (#5867)

parent dad5e12e
...@@ -114,7 +114,7 @@ setup( ...@@ -114,7 +114,7 @@ setup(
packages=find_packages("src"), packages=find_packages("src"),
install_requires=[ install_requires=[
"numpy", "numpy",
"tokenizers == 0.8.1.rc1", "tokenizers == 0.8.1.rc2",
# dataclasses for Python versions that don't have it # dataclasses for Python versions that don't have it
"dataclasses;python_version<'3.7'", "dataclasses;python_version<'3.7'",
# utilities from PyPA to e.g. compare versions # utilities from PyPA to e.g. compare versions
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment