Commit db350394 authored by Sylvain Gugger's avatar Sylvain Gugger
Browse files

Finish conversion of REALM doc to MDX

parent fe78fe98
...@@ -14,8 +14,7 @@ specific language governing permissions and limitations under the License. ...@@ -14,8 +14,7 @@ specific language governing permissions and limitations under the License.
## Overview ## Overview
The REALM model was proposed in `REALM: Retrieval-Augmented Language Model Pre-Training The REALM model was proposed in [REALM: Retrieval-Augmented Language Model Pre-Training](https://arxiv.org/abs/2002.08909) by Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat and Ming-Wei Chang. It's a
<https://arxiv.org/abs/2002.08909>`__ by Kelvin Guu, Kenton Lee, Zora Tung, Panupong Pasupat and Ming-Wei Chang. It's a
retrieval-augmented language model that firstly retrieves documents from a textual knowledge corpus and then retrieval-augmented language model that firstly retrieves documents from a textual knowledge corpus and then
utilizes retrieved documents to process question answering tasks. utilizes retrieved documents to process question answering tasks.
...@@ -34,8 +33,8 @@ explicit and implicit knowledge storage on three popular Open-QA benchmarks, and ...@@ -34,8 +33,8 @@ explicit and implicit knowledge storage on three popular Open-QA benchmarks, and
methods by a significant margin (4-16% absolute accuracy), while also providing qualitative benefits such as methods by a significant margin (4-16% absolute accuracy), while also providing qualitative benefits such as
interpretability and modularity.* interpretability and modularity.*
This model was contributed by `qqaatw <https://huggingface.co/qqaatw>`__. The original code can be found `here This model was contributed by [qqaatw](https://huggingface.co/qqaatw). The original code can be found
<https://github.com/google-research/language/tree/master/language/realm>`__. [here](https://github.com/google-research/language/tree/master/language/realm).
## RealmConfig ## RealmConfig
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment