Unverified Commit 28d16e7a authored by Tim Isbister's avatar Tim Isbister Committed by GitHub
Browse files

Update README.md (#8635)

parent b290195a
...@@ -90,7 +90,7 @@ selected tokens (which may be part of words), they mask randomly selected words ...@@ -90,7 +90,7 @@ selected tokens (which may be part of words), they mask randomly selected words
to that word). This technique has been refined for Chinese in [this paper](https://arxiv.org/abs/1906.08101). to that word). This technique has been refined for Chinese in [this paper](https://arxiv.org/abs/1906.08101).
To fine-tune a model using whole word masking, use the following script: To fine-tune a model using whole word masking, use the following script:
```bash
python run_mlm_wwm.py \ python run_mlm_wwm.py \
--model_name_or_path roberta-base \ --model_name_or_path roberta-base \
--dataset_name wikitext \ --dataset_name wikitext \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment