README.md 1.16 KB
Newer Older
haileyschoelkopf's avatar
haileyschoelkopf committed
1
2
3
# LAMBADA

### Paper
lintangsutawika's avatar
lintangsutawika committed
4
5
6
Title: `The LAMBADA dataset: Word prediction requiring a broad discourse context`

Abstract: https://arxiv.org/pdf/1606.06031.pdf
haileyschoelkopf's avatar
haileyschoelkopf committed
7
8
9
10
11
12
13
14
15
16
17

LAMBADA is a dataset to evaluate the capabilities of computational models for text
understanding by means of a word prediction task. LAMBADA is a collection of narrative
passages sharing the characteristic that human subjects are able to guess their last
word if they are exposed to the whole passage, but not if they only see the last
sentence preceding the target word. To succeed on LAMBADA, computational models
cannot simply rely on local context, but must be able to keep track of information
in the broader discourse.

Homepage: https://zenodo.org/record/2630551#.X4Xzn5NKjUI

lintangsutawika's avatar
lintangsutawika committed
18
19
20
21
22
23
24
25
26
27
28
29
### Groups and Tasks

#### Groups

- `lambada`

#### Tasks

- `lambada_openai`
- `lambada_standard`


haileyschoelkopf's avatar
haileyschoelkopf committed
30
31
32
33
34
35
36
37
38
### Citation

@misc{
    author={Paperno, Denis and Kruszewski, Germán and Lazaridou, Angeliki and Pham, Quan Ngoc and Bernardi, Raffaella and Pezzelle, Sandro and Baroni, Marco and Boleda, Gemma and Fernández, Raquel},
    title={The LAMBADA dataset},
    DOI={10.5281/zenodo.2630551},
    publisher={Zenodo},
    year={2016},
    month={Aug}
lintangsutawika's avatar
lintangsutawika committed
39
}