README.md 402 Bytes
Newer Older
Jannes's avatar
Jannes committed
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
---

language: swedish

---

# BERTSSON Models

The models are trained on:
- Government Text
- Swedish Literature
- Swedish News

Corpus size: Roughly 6B tokens.

The following models are currently available:

- **bertsson** - A BERT base model trained with the same hyperparameters as first published by Google.

All models are cased and trained with whole word masking.

Stay tuned for evaluations.