Add example for fine tuning BERT language model (#1)

Adds an example for loading a pre-trained BERT model and fine tune it as a language model (masked tokens & nextSentence) on your target corpus.

Add example for fine tuning BERT language model (#1)
Adds an example for loading a pre-trained BERT model and fine tune it as a language model (masked tokens & nextSentence) on your target corpus.
a58361f1 · deepset · GitHub · 786cc412 · a58361f1
Unverified Commit a58361f1 authored Dec 18, 2018 by deepset Committed by GitHub Dec 18, 2018
Expand all Show whitespace changes
Inline Side-by-side

Showing with 674 additions and 0 deletions

examples/run_lm_finetuning.py examples/run_lm_finetuning.py +674 -0

No files found.
--- a/examples/run_lm_finetuning.py
+++ b/examples/run_lm_finetuning.py