Unverified Commit 91f4c84a authored by Maria Khalusova's avatar Maria Khalusova Committed by GitHub
Browse files

CTC example: updated trainer parameters to save tokenizer (#23243)

trainer parameters changed to save tokenizer in addition to feature_extractor
parent 33357243
......@@ -705,7 +705,7 @@ def main():
compute_metrics=compute_metrics,
train_dataset=vectorized_datasets["train"] if training_args.do_train else None,
eval_dataset=vectorized_datasets["eval"] if training_args.do_eval else None,
tokenizer=feature_extractor,
tokenizer=processor,
)
# 8. Finally, we can start training
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment