Skip to content

GitLab

Unverified Commit a63bd367 authored by Simon Sardorf's avatar Simon Sardorf Committed by GitHub
Browse files

Remove input and target reset after preprocessing (#15741) 

Remove input and target reset after preprocessing
parent 2c2a31ff
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
examples/pytorch/summarization/run_summarization.py
View file @ a63bd367
......@@ -483,8 +483,6 @@ def main():
inputs.append(examples[text_column][i])
targets.append(examples[summary_column][i])
inputs = examples[text_column]
targets = examples[summary_column]
inputs = [prefix + inp for inp in inputs]
model_inputs = tokenizer(inputs, max_length=data_args.max_source_length, padding=padding, truncation=True)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment