Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
chenpangpang
transformers
Commits
fa735208
Unverified
Commit
fa735208
authored
Oct 30, 2019
by
Victor SANH
Committed by
GitHub
Oct 30, 2019
Browse files
update readme - fix example command distil*
parent
c7058d82
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
examples/distillation/README.md
examples/distillation/README.md
+3
-3
No files found.
examples/distillation/README.md
View file @
fa735208
...
...
@@ -108,7 +108,7 @@ python train.py \
--student_config
training_configs/distilbert-base-uncased.json
\
--teacher_type
bert
\
--teacher_name
bert-base-uncased
\
--alpha_ce
5.0
--alpha_mlm
2.0
--alpha_cos
1.0
--mlm
\
--alpha_ce
5.0
--alpha_mlm
2.0
--alpha_cos
1.0
--alpha_clm
0.0
--mlm
\
--freeze_pos_embs
\
--dump_path
serialization_dir/my_first_training
\
--data_file
data/binarized_text.bert-base-uncased.pickle
\
...
...
@@ -144,7 +144,7 @@ python -m torch.distributed.launch \
--student_config
training_configs/distilbert-base-uncased.json
\
--teacher_type
bert
\
--teacher_name
bert-base-uncased
\
--alpha_ce
0.33
--alpha_mlm
0.33
--alpha_cos
0.33
--mlm
\
--alpha_ce
0.33
--alpha_mlm
0.33
--alpha_cos
0.33
--alpha_clm
0.0
--mlm
\
--freeze_pos_embs
\
--dump_path
serialization_dir/my_first_training
\
--data_file
data/binarized_text.bert-base-uncased.pickle
\
...
...
@@ -166,4 +166,4 @@ If you find the ressource useful, you should cite the following paper:
booktitle={NeurIPS EMC^2 Workshop},
year={2019}
}
```
\ No newline at end of file
```
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment