Commits · 8d1d1ffde25f6c7b3c472bd8f82f462b14ab8c11 · chenpangpang / transformers

25 Mar, 2019 1 commit
- Corrected the displayed loss when gradient_accumulation_steps > 1 · 8d1d1ffd
  Matthew Carrigan authored Mar 25, 2019
  
  8d1d1ffd
21 Mar, 2019 9 commits
- Added proper context management to ensure cleanup happens in the right · abb7d1ff
  Matthew Carrigan authored Mar 21, 2019
```
order.
```
  abb7d1ff
- Added a --reduce_memory option to the training script to keep training · 06a30cfd
  Matthew Carrigan authored Mar 21, 2019
```
data on disc as a memmap rather than in memory
```
  06a30cfd
- Added a --reduce_memory option to the training script to keep training · 7d1ae644
  Matthew Carrigan authored Mar 21, 2019
```
data on disc as a memmap rather than in memory
```
  7d1ae644
- Added a --reduce_memory option to shelve docs to disc instead of keeping them in memory. · 2bba7f81
  Matthew Carrigan authored Mar 21, 2019
  
  2bba7f81
- Removing a couple of other old unnecessary comments · 8733ffcb
  Matthew Carrigan authored Mar 21, 2019
  
  8733ffcb
- Fixed up the notes on a possible future low-memory path · 8a861048
  Matthew Carrigan authored Mar 21, 2019
  
  8a861048
- Reduced memory usage for pregenerating the data a lot by writing it · a8a577ba
  Matthew Carrigan authored Mar 21, 2019
```
out on the fly without shuffling - the Sampler in the finetuning script
will shuffle for us.
```
  a8a577ba
- Reduced memory usage for pregenerating the data a lot by writing it · 0ae59e66
  Matthew Carrigan authored Mar 21, 2019
```
out on the fly without shuffling - the Sampler in the finetuning script
will shuffle for us.
```
  0ae59e66
- Removed an old irrelevant comment · 6a9038ba
  Matthew Carrigan authored Mar 21, 2019
  
  6a9038ba
20 Mar, 2019 9 commits
- Small README changes · 29a392fb
  Matthew Carrigan authored Mar 20, 2019
  
  29a392fb
- Adding README · 832b2b00
  Matthew Carrigan authored Mar 20, 2019
  
  832b2b00
- Syncing up argument names between the scripts · 934d3f4d
  Matthew Carrigan authored Mar 20, 2019
  
  934d3f4d
- Move old finetuning script into the new folder · f19ba35b
  Matthew Carrigan authored Mar 20, 2019
  
  f19ba35b
- PEP8 and formatting cleanups · 7de5c6aa
  Matthew Carrigan authored Mar 20, 2019
  
  7de5c6aa
- Added final TODOs · 1798e98e
  Matthew Carrigan authored Mar 20, 2019
  
  1798e98e
- Fixed embarrassing indentation problem · c64c2fc4
  Matthew Carrigan authored Mar 20, 2019
  
  c64c2fc4
- Fixed logging · 0540d360
  Matthew Carrigan authored Mar 20, 2019
  
  0540d360
- First commit of the new LM finetuning · 976554a4
  Matthew Carrigan authored Mar 20, 2019
  
  976554a4