"...composable_kernel_onnx.git" did not exist on "0bd6b842b96d052e03b4726ad63f8d337550cf1f"
Unverified Commit 2fdab323 authored by Yongbo Wang's avatar Yongbo Wang Committed by GitHub
Browse files

typo

parent 813e4d18
...@@ -292,7 +292,7 @@ class TransfoXLTokenizer(object): ...@@ -292,7 +292,7 @@ class TransfoXLTokenizer(object):
return "".join(output) return "".join(output)
def whitespace_tokenize(self, text): def whitespace_tokenize(self, text):
"""Runs basic whitespace cleaning and splitting on a peice of text.""" """Runs basic whitespace cleaning and splitting on a piece of text."""
text = text.strip() text = text.strip()
if not text: if not text:
return [] return []
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment