Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
e6d9cdaa
Unverified
Commit
e6d9cdaa
authored
Nov 08, 2020
by
Sam Shleifer
Committed by
GitHub
Nov 08, 2020
Browse files
[s2s/distill] remove run_distiller.sh, fix xsum script (#8412)
parent
66582492
Changes
2
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
1 addition
and
10 deletions
+1
-10
examples/seq2seq/run_distiller.sh
examples/seq2seq/run_distiller.sh
+0
-10
examples/seq2seq/train_distilbart_xsum.sh
examples/seq2seq/train_distilbart_xsum.sh
+1
-0
No files found.
examples/seq2seq/run_distiller.sh
deleted
100755 → 0
View file @
66582492
# Add parent directory to python path to access lightning_base.py
export
PYTHONPATH
=
"../"
:
"
${
PYTHONPATH
}
"
python distillation.py
\
--learning_rate
=
3e-4
\
--do_train
\
--do_predict
\
--fp16
\
--val_check_interval
0.1
\
"
$@
"
examples/seq2seq/train_distilbart_xsum.sh
View file @
e6d9cdaa
...
...
@@ -2,6 +2,7 @@
export
PYTHONPATH
=
"../"
:
"
${
PYTHONPATH
}
"
python distillation.py
\
--teacher
facebook/bart-large-xsum
--data_dir
xsum
\
--tokenizer_name
facebook/bart-large-xsum
\
--student_decoder_layers
6
--student_encoder_layers
12
\
--freeze_encoder
--freeze_embeds
\
--learning_rate
=
3e-4
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment