Commit 39eb31e1 authored by Rabeeh KARIMI's avatar Rabeeh KARIMI
Browse files

remove reloading tokenizer in the training, adding it to the evaluation part

parent 350bb6bf
...@@ -448,7 +448,6 @@ def main(): ...@@ -448,7 +448,6 @@ def main():
# Load a trained model and vocabulary that you have fine-tuned # Load a trained model and vocabulary that you have fine-tuned
model = model_class.from_pretrained(args.output_dir) model = model_class.from_pretrained(args.output_dir)
tokenizer = tokenizer_class.from_pretrained(args.output_dir, do_lower_case=args.do_lower_case)
model.to(args.device) model.to(args.device)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment