Skip to content

GitLab

Unverified Commit c7cb1aa2 authored by Sylvain Gugger's avatar Sylvain Gugger Committed by GitHub
Browse files

Bump tokenizers (#8419)

parent 78d706f3
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
setup.py
View file @ c7cb1aa2
...@@ -129,7 +129,7 @@ setup( ...@@ -129,7 +129,7 @@ setup(
packages=find_packages("src"), packages=find_packages("src"),
install_requires=[ install_requires=[
"numpy", "numpy",
"tokenizers == 0.9.2", "tokenizers == 0.9.3",
# dataclasses for Python versions that don't have it # dataclasses for Python versions that don't have it
"dataclasses;python_version<'3.7'", "dataclasses;python_version<'3.7'",
# utilities from PyPA to e.g. compare versions # utilities from PyPA to e.g. compare versions
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment