Commits · dedb2ef78cdf54a54b6986ac0e8fc0045dd4fa07 · OpenDAS / Megatron-LM

30 Mar, 2020 1 commit
- removed building tokenizer from bert dataset · dedb2ef7
  Mohammad authored Mar 30, 2020
  
  dedb2ef7
29 Mar, 2020 1 commit
- utils partially refactored and tested · 3f58649b
  Mohammad authored Mar 28, 2020
  
  3f58649b
28 Mar, 2020 1 commit
- tokenizer moved to its own directory · 11220df8
  Mohammad authored Mar 28, 2020
  
  11220df8
17 Mar, 2020 1 commit
- moved albert to bert · 09e05c6f
  Mohammad Shoeybi authored Mar 16, 2020
  
  09e05c6f
04 Dec, 2019 1 commit
- minor cleaning · 75a86a1d
  Mohammad Shoeybi authored Dec 03, 2019
  
  75a86a1d
24 Nov, 2019 3 commits
- minor fix · 5300c69f
  Mohammad Shoeybi authored Nov 24, 2019
  
  5300c69f
- resolved reproducibity issue · e2add0fd
  Mohammad Shoeybi authored Nov 24, 2019
  
  e2add0fd
- zero worker seems to be working · 0601702a
  Mohammad Shoeybi authored Nov 24, 2019
  
  0601702a
21 Nov, 2019 1 commit
- fixed padding issue · f6a6811f
  Mohammad Shoeybi authored Nov 20, 2019
  
  f6a6811f
20 Nov, 2019 2 commits
- added write option for index map · 9ea9d50f
  Mohammad Shoeybi authored Nov 20, 2019
  
  9ea9d50f
- fixed couple of bugs in helpers · 690291dd
  Mohammad Shoeybi authored Nov 20, 2019
  
  690291dd
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
13 Nov, 2019 1 commit
- Plugging new dataset stuff together. · 0058b1a5
  Jared Casper authored Nov 13, 2019
```
Some cleanup of types, etc. in the helpers cpp code.
```
  0058b1a5
11 Nov, 2019 1 commit
- c++ code working · f51ceb7c
  Mohammad Shoeybi authored Nov 10, 2019
  
  f51ceb7c
08 Nov, 2019 3 commits
- before optimization · 6140718f
  Mohammad Shoeybi authored Nov 08, 2019
  
  6140718f
- built simple test for dataset · c125d247
  Mohammad Shoeybi authored Nov 07, 2019
  
  c125d247
- added dataset · 7120e931
  Mohammad Shoeybi authored Nov 07, 2019
  
  7120e931