Bump tokenizers (#8419)

c7cb1aa2 · Sylvain Gugger · GitHub · 78d706f3 · c7cb1aa2
Unverified Commit c7cb1aa2 authored Nov 09, 2020 by Sylvain Gugger Committed by GitHub Nov 09, 2020
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

setup.py setup.py +1 -1

No files found.
--- a/setup.py
+++ b/setup.py
@@ -129,7 +129,7 @@ setup(
    packages=find_packages("src"),
    install_requires=[
        "numpy",
-        "tokenizers == 0.9.2",
+        "tokenizers == 0.9.3",
        # dataclasses for Python versions that don't have it
        "dataclasses;python_version<'3.7'",
        # utilities from PyPA to e.g. compare versions