Unverified Commit 2d8340a9 authored by Patrick von Platen's avatar Patrick von Platen Committed by GitHub
Browse files

[Reformer] Move model card to google model (#4113)

* correct model card

* remove model card from patrick von platen
parent d713cfc5
...@@ -3,9 +3,8 @@ Crime and Punishment text was taken from `gs://trax-ml/reformer/crime-and-punish ...@@ -3,9 +3,8 @@ Crime and Punishment text was taken from `gs://trax-ml/reformer/crime-and-punish
Model was trained in flax using colab notebook proposed by authors: https://colab.research.google.com/github/google/trax/blob/master/trax/models/reformer/text_generation.ipynb Model was trained in flax using colab notebook proposed by authors: https://colab.research.google.com/github/google/trax/blob/master/trax/models/reformer/text_generation.ipynb
Weights were converted to Hugging Face PyTorch `ReformerModelWithLMHead`. Weights were converted to Hugging Face PyTorch `ReformerModelWithLMHead`.
Model is used as a proof of concept that the forward pass works for a `ReformerModelWithLMHead`. The model is a character level language model. Language from in `crime-and-punishment` style
Given that the model was trained only for 30mins on a ~0.5M tokens dataset and has only 320 tokens, can be generated as follows:
the generation results are reasonable:
```python ```python
model = ReformerModelWithLMHead.from_pretrained("patrickvonplaten/reformer-crime-and-punish") model = ReformerModelWithLMHead.from_pretrained("patrickvonplaten/reformer-crime-and-punish")
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment