Skip to content

GitLab

"...git@developer.sourcefind.cn:chenpangpang/transformers.git" did not exist on "0a2fecdf90081102641d6b08795ddc0333443b32"
Unverified Commit e6d9cdaa authored by Sam Shleifer's avatar Sam Shleifer Committed by GitHub
Browse files

[s2s/distill] remove run_distiller.sh, fix xsum script (#8412)

parent 66582492
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 10 deletions
examples/seq2seq/run_distiller.sh deleted 100755 → 0
View file @ 66582492
# Add parent directory to python path to access lightning_base.py
export PYTHONPATH="../":"${PYTHONPATH}"
python distillation.py \
--learning_rate=3e-4 \
--do_train \
--do_predict \
--fp16 \
--val_check_interval 0.1 \
"$@"
examples/seq2seq/train_distilbart_xsum.sh
View file @ e6d9cdaa
......@@ -2,6 +2,7 @@
export PYTHONPATH="../":"${PYTHONPATH}"
python distillation.py \
--teacher facebook/bart-large-xsum --data_dir xsum \
--tokenizer_name facebook/bart-large-xsum \
--student_decoder_layers 6 --student_encoder_layers 12 \
--freeze_encoder --freeze_embeds \
--learning_rate=3e-4 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment