Skip to content

GitLab

Commit 6fc03d3c authored by Louis Martin's avatar Louis Martin Committed by Facebook Github Bot
Browse files

Update README.md 

Summary: Pull Request resolved: https://github.com/fairinternal/fairseq-py/pull/913

Differential Revision: D18565866

Pulled By: myleott

fbshipit-source-id: e845759dafe915805c2e38f53c6835cbcef5db2f
parent 7fb1df53
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
examples/camembert/README.md
View file @ 6fc03d3c
...@@ -4,6 +4,8 @@ ...@@ -4,6 +4,8 @@
CamemBERT is a pretrained language model trained on 138GB of French text based on RoBERTa. CamemBERT is a pretrained language model trained on 138GB of French text based on RoBERTa.
Also available in [github.com/huggingface/transformers](https://github.com/huggingface/transformers/).
## Pre-trained models ## Pre-trained models
Model | #params | vocab size | Download Model | #params | vocab size | Download
...@@ -44,7 +46,7 @@ camembert.fill_mask(masked_line, topk=3) ...@@ -44,7 +46,7 @@ camembert.fill_mask(masked_line, topk=3)
##### Extract features from Camembert: ##### Extract features from Camembert:
```python ```python
# Extract the last layer's features # Extract the last layer's features
line = "J'aime le camembert!" line = "J'aime le camembert !"
tokens = camembert.encode(line) tokens = camembert.encode(line)
last_layer_features = camembert.extract_features(tokens) last_layer_features = camembert.extract_features(tokens)
assert last_layer_features.size() == torch.Size([1, 10, 768]) assert last_layer_features.size() == torch.Size([1, 10, 768])
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment