Skip to content

GitLab

Unverified Commit fa735208 authored by Victor SANH's avatar Victor SANH Committed by GitHub
Browse files

update readme - fix example command distil*

parent c7058d82
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
examples/distillation/README.md
View file @ fa735208
...@@ -108,7 +108,7 @@ python train.py \ ...@@ -108,7 +108,7 @@ python train.py \
--student_config training_configs/distilbert-base-uncased.json \ --student_config training_configs/distilbert-base-uncased.json \
--teacher_type bert \ --teacher_type bert \
--teacher_name bert-base-uncased \ --teacher_name bert-base-uncased \
--alpha_ce 5.0 --alpha_mlm 2.0 --alpha_cos 1.0 --mlm \ --alpha_ce 5.0 --alpha_mlm 2.0 --alpha_cos 1.0 --alpha_clm 0.0 --mlm \
--freeze_pos_embs \ --freeze_pos_embs \
--dump_path serialization_dir/my_first_training \ --dump_path serialization_dir/my_first_training \
--data_file data/binarized_text.bert-base-uncased.pickle \ --data_file data/binarized_text.bert-base-uncased.pickle \
...@@ -144,7 +144,7 @@ python -m torch.distributed.launch \ ...@@ -144,7 +144,7 @@ python -m torch.distributed.launch \
--student_config training_configs/distilbert-base-uncased.json \ --student_config training_configs/distilbert-base-uncased.json \
--teacher_type bert \ --teacher_type bert \
--teacher_name bert-base-uncased \ --teacher_name bert-base-uncased \
--alpha_ce 0.33 --alpha_mlm 0.33 --alpha_cos 0.33 --mlm \ --alpha_ce 0.33 --alpha_mlm 0.33 --alpha_cos 0.33 --alpha_clm 0.0 --mlm \
--freeze_pos_embs \ --freeze_pos_embs \
--dump_path serialization_dir/my_first_training \ --dump_path serialization_dir/my_first_training \
--data_file data/binarized_text.bert-base-uncased.pickle \ --data_file data/binarized_text.bert-base-uncased.pickle \
...@@ -166,4 +166,4 @@ If you find the ressource useful, you should cite the following paper: ...@@ -166,4 +166,4 @@ If you find the ressource useful, you should cite the following paper:
booktitle={NeurIPS EMC^2 Workshop}, booktitle={NeurIPS EMC^2 Workshop},
year={2019} year={2019}
} }
``` ```
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment