fairseq/models/transformer.py · b2374e52f84e138811864dfb10d8ff768d396b2e · OpenDAS / Fairseq · GitLab

Find file Blame History Permalink

caching v3 (cache keys, values, process only last time step) (#241) · b2374e52
Alexei Baevski authored Apr 05, 2018
```
- process only last time step during generation
- cache keys and values
- dont apply masking during generation
```
b2374e52

transformer.py 17.5 KB