Skip to content

GitLab

"git@developer.sourcefind.cn:hehl2/torchaudio.git" did not exist on "c2740644ee31d29861d3d9977a43af1e71779054"
Unverified Commit a63bd367 authored by Simon Sardorf's avatar Simon Sardorf Committed by GitHub
Browse files

Remove input and target reset after preprocessing (#15741) 

Remove input and target reset after preprocessing
parent 2c2a31ff
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 2 deletions
examples/pytorch/summarization/run_summarization.py
View file @ a63bd367
...@@ -483,8 +483,6 @@ def main(): ...@@ -483,8 +483,6 @@ def main():
inputs.append(examples[text_column][i]) inputs.append(examples[text_column][i])
targets.append(examples[summary_column][i]) targets.append(examples[summary_column][i])
inputs = examples[text_column]
targets = examples[summary_column]
inputs = [prefix + inp for inp in inputs] inputs = [prefix + inp for inp in inputs]
model_inputs = tokenizer(inputs, max_length=data_args.max_source_length, padding=padding, truncation=True) model_inputs = tokenizer(inputs, max_length=data_args.max_source_length, padding=padding, truncation=True)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment