Commits · f6a6811fdf4bed14569b4d9e664216a0acc9874c · wuxk1 / Megatron-LM

"tools/generate-unit-test-expect/IRC/IRC08/IRC08-08.xyz" did not exist on "06a6f38189092c7ba4aced6f90fa663d5c5ae0c2"

20 Nov, 2019 1 commit
- fixed couple of bugs in helpers · 690291dd
  Mohammad Shoeybi authored Nov 20, 2019
  
  690291dd
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
13 Nov, 2019 1 commit
- Plugging new dataset stuff together. · 0058b1a5
  Jared Casper authored Nov 13, 2019
```
Some cleanup of types, etc. in the helpers cpp code.
```
  0058b1a5
09 Nov, 2019 1 commit
- Add ability to take a contiguous slice to indexed_dataset. · 61697cab
  Jared Casper authored Nov 08, 2019
```
Also removed the fix_lua_indexing stuff from fairseq.
```
  61697cab
08 Nov, 2019 1 commit
- Add document index to index file. An empty sentence no longer separate documents. · 87bbe9be
  Jared Casper authored Nov 07, 2019
  
  87bbe9be
07 Nov, 2019 1 commit
- Initial commit of multiprocess preprocess and extracted copy of fairseq's indexed_dataset. · 1237533e
  Jared Casper authored Nov 07, 2019
  
  1237533e