README.md 539 Bytes
Newer Older
Julien Chaumond's avatar
Julien Chaumond committed
1
2
3
4
## How to build a dummy model


```python
Sylvain Gugger's avatar
Sylvain Gugger committed
5
from transformers BertConfig, BertForMaskedLM, BertTokenizer, TFBertForMaskedLM
Julien Chaumond's avatar
Julien Chaumond committed
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21

SMALL_MODEL_IDENTIFIER = "julien-c/bert-xsmall-dummy"
DIRNAME = "./bert-xsmall-dummy"

config = BertConfig(10, 20, 1, 1, 40)

model = BertForMaskedLM(config)
model.save_pretrained(DIRNAME)

tf_model = TFBertForMaskedLM.from_pretrained(DIRNAME, from_pt=True)
tf_model.save_pretrained(DIRNAME)

# Slightly different for tokenizer.
# tokenizer = BertTokenizer.from_pretrained(DIRNAME)
# tokenizer.save_pretrained()
```