Unverified Commit 8049dfa4 authored by Yongrae Jo's avatar Yongrae Jo Committed by GitHub
Browse files

Update run_t5_mlm_flax.py (#16421)

Fix typo in comment: proprocessed -> preprocessed
parent 925fc57b
......@@ -338,7 +338,7 @@ class FlaxDataCollatorForT5MLM:
f"`labels` are incorrectly preprocessed. `labels` length is {batch['labels'].shape[-1]}, but should be {self.target_length}."
)
# to check that tokens are correctly proprocessed, one can run `self.tokenizer.batch_decode(input_ids)` and `self.tokenizer.batch_decode(labels)` here...
# to check that tokens are correctly preprocessed, one can run `self.tokenizer.batch_decode(input_ids)` and `self.tokenizer.batch_decode(labels)` here...
batch["decoder_input_ids"] = shift_tokens_right(
batch["labels"], self.pad_token_id, self.decoder_start_token_id
)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment