Skip to content

GitLab

"model/models/vscode:/vscode.git/clone" did not exist on "139f84cf21f8d8107f69c1404f17a8840c6d67d0"
Unverified Commit c96aca3a authored by Ankur Singh's avatar Ankur Singh Committed by GitHub
Browse files

Added the necessay import of module (#30804)

parent ccdabc56
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
docs/source/en/training.md
View file @ c96aca3a
......@@ -186,6 +186,7 @@ so we can just convert that directly to a NumPy array without tokenization!
```py
from transformers import AutoTokenizer
import numpy as np
tokenizer = AutoTokenizer.from_pretrained("google-bert/bert-base-cased")
tokenized_data = tokenizer(dataset["sentence"], return_tensors="np", padding=True)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment