Unverified Commit 13dd2acc authored by Anthony MOI's avatar Anthony MOI Committed by GitHub
Browse files

Bump tokenizers version to final 0.7.0 (#3898)

parent f16540fc
...@@ -96,7 +96,7 @@ setup( ...@@ -96,7 +96,7 @@ setup(
packages=find_packages("src"), packages=find_packages("src"),
install_requires=[ install_requires=[
"numpy", "numpy",
"tokenizers == 0.7.0rc7", "tokenizers == 0.7.0",
# dataclasses for Python versions that don't have it # dataclasses for Python versions that don't have it
"dataclasses;python_version<'3.7'", "dataclasses;python_version<'3.7'",
# accessing files from S3 directly # accessing files from S3 directly
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment