"lm_eval/tasks/mmmu/_tech_and_engineering.yaml" did not exist on "decc533d02222f3b866d9a89263277fe0cc2fcb2"
README.md 1.06 KB
Newer Older
martindh's avatar
martindh committed
1
---
2
language: fr
martindh's avatar
martindh committed
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
---

# camembert-base-fquad

## Description

A native French Question Answering model [CamemBERT-base](https://camembert-model.fr/) fine-tuned on [FQuAD](https://fquad.illuin.tech/).

## Evaluation results

On the development set.

```shell
{"f1": 88.1, "exact_match": 78.1}
```

On the test set.

```shell
{"f1": 88.3, "exact_match": 78.0}
```

## Usage

```python
from transformers import pipeline

nlp = pipeline('question-answering', model='illuin/camembert-base-fquad', tokenizer='illuin/camembert-base-fquad')

nlp({
    'question': "Qui est Claude Monet?",
    'context': "Claude Monet, n茅 le 14 novembre 1840 脿 Paris et mort le 5 d茅cembre 1926 脿 Giverny, est un peintre fran莽ais et l鈥檜n des fondateurs de l'impressionnisme."
})
```

## Citation

If you use our work, please cite:

```bibtex
@article{dHoffschmidt2020FQuADFQ,
  title={FQuAD: French Question Answering Dataset},
  author={Martin d'Hoffschmidt and Maxime Vidal and Wacim Belblidia and Tom Brendl'e and Quentin Heinrich},
  journal={ArXiv},
  year={2020},
  volume={abs/2002.06071}
}
```