Unverified Commit 94cb73c2 authored by Viktor Alm's avatar Viktor Alm Committed by GitHub
Browse files

Add image and metadata (#4345)

Unfortunately i accidentally orphaned my other PR
parent a0eebdc4
---
language: norwegian
thumbnail: https://i.imgur.com/QqSEC5I.png
---
# Norwegian Electra # Norwegian Electra
Image incoming, im going to have som fun with this one. ![Image of norwegian electra](https://i.imgur.com/QqSEC5I.png)
Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8) Trained on Oscar + wikipedia + opensubtitles + some other data I had with the awesome power of TPUs(V3-8)
Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet. Use with caution. I have no downstream tasks in Norwegian to test on so I have no idea of its performance yet.
# Model
## Electra: Pre-training Text Encoders as Discriminators Rather Than Generators
Kevin Clark and Minh-Thang Luong and Quoc V. Le and Christopher D. Manning
- https://openreview.net/pdf?id=r1xMH1BtvB
- https://github.com/google-research/electra
# Acknowledgments # Acknowledgments
### TensorFlow Research Cloud ### TensorFlow Research Cloud
Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️ Research supported with Cloud TPUs from Google's TensorFlow Research Cloud (TFRC). Thanks for providing access to the TFRC ❤️
- https://www.tensorflow.org/tfrc - https://www.tensorflow.org/tfrc
#### OSCAR corpus #### OSCAR corpus
- https://oscar-corpus.com/ - https://oscar-corpus.com/
#### OPUS #### OPUS
- http://opus.nlpl.eu/ - http://opus.nlpl.eu/
- http://www.opensubtitles.org/ - http://www.opensubtitles.org/
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment