Unverified Commit b1ddea7f authored by Shaden Smith's avatar Shaden Smith Committed by GitHub
Browse files

Point BERT pretraining tutorial to new perf tuning. (#246)

parent c5c9aaaa
...@@ -301,7 +301,9 @@ Note: ...@@ -301,7 +301,9 @@ Note:
generated with transformer kernel must to be loaded by the model with generated with transformer kernel must to be loaded by the model with
transformer kernel enabled (such as in fine-tuning). transformer kernel enabled (such as in fine-tuning).
For more details about the transformer kernel, please see [DeepSpeed Transformer Kernel](/transformer_kernel/) and [DeepSpeed Fast-Bert Training](/fast_bert/). For more details about the transformer kernel, please see [DeepSpeed
Transformer Kernel](/tutorials/transformer_kernel/) and [DeepSpeed Fast-Bert
Training](https://www.deepspeed.ai/news/2020/05/27/fastest-bert-training.html).
### Start Training ### Start Training
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment