Commits · 8ba76558d04235be2ff2fb6932d18f8f041e18e0 · OpenDAS / Megatron-LM

15 Apr, 2020 1 commit
- Correct title index in helpers and complete the ICDataset functionality · 3dc39c4a
  Neel Kant authored Apr 14, 2020
  
  3dc39c4a
14 Apr, 2020 4 commits
- Modify InverseClozeDataset and its usage to use blocks · 46b2addd
  Neel Kant authored Apr 13, 2020
  
  46b2addd
- Debug helpers compilation · 64aef3a5
  Neel Kant authored Apr 13, 2020
  
  64aef3a5
- Modify preprocess_data.py to accommodate titles dataset · 27ecc17a
  Neel Kant authored Apr 13, 2020
  
  27ecc17a
- Add build_blocks_mapping code to helpers.cpp · 7bd2a3c5
  Neel Kant authored Apr 13, 2020
  
  7bd2a3c5
09 Apr, 2020 1 commit
- Qualitative test prep works · 360885ee
  Neel Kant authored Apr 09, 2020
  
  360885ee
08 Apr, 2020 1 commit
- Add ICT qualitative test script · 7504ef44
  Neel Kant authored Apr 08, 2020
  
  7504ef44
07 Apr, 2020 2 commits
- Fix issue with validation dataloader · 064bdc46
  Neel Kant authored Apr 07, 2020
  
  064bdc46
- Complete implementation of InverseClozeDataset with IndexedDataset · 72fb0d5c
  Neel Kant authored Apr 06, 2020
  
  72fb0d5c
05 Apr, 2020 1 commit
- Hacks to build IndexedDataset and run pretrain · b03af49e
  Neel Kant authored Apr 05, 2020
  
  b03af49e
03 Apr, 2020 1 commit
- Implement InverseClozeDataset with IndexedDataset · 4558e42f
  Neel Kant authored Apr 03, 2020
  
  4558e42f
01 Apr, 2020 1 commit
- addressed comments from raul, neel, and jared · bf3ce751
  Mohammad authored Apr 01, 2020
  
  bf3ce751
30 Mar, 2020 4 commits
- removed unused values in samplers · 259062c2
  Mohammad authored Mar 30, 2020
  
  259062c2
- added samplers from data_utils · 32e1ddb0
  Mohammad authored Mar 30, 2020
  
  32e1ddb0
- removed building tokenizer from bert dataset · dedb2ef7
  Mohammad authored Mar 30, 2020
  
  dedb2ef7
- both bert and gpt are working · 5f8623db
  Mohammad authored Mar 29, 2020
  
  5f8623db
29 Mar, 2020 1 commit
- utils partially refactored and tested · 3f58649b
  Mohammad authored Mar 28, 2020
  
  3f58649b
28 Mar, 2020 2 commits
- tokenizer moved to its own directory · 11220df8
  Mohammad authored Mar 28, 2020
  
  11220df8
- arguments.py refactored · 94e2ca57
  Mohammad authored Mar 27, 2020
  
  94e2ca57
27 Mar, 2020 1 commit
- added global variables · 83aa9219
  Mohammad authored Mar 27, 2020
  
  83aa9219
24 Mar, 2020 1 commit
- BERT downstream tasks: RACE, MNLI, QQP · 90ef2e28
  Mohammad Shoeybi authored Mar 23, 2020
  
  90ef2e28
17 Mar, 2020 1 commit
- moved albert to bert · 09e05c6f
  Mohammad Shoeybi authored Mar 16, 2020
  
  09e05c6f
26 Dec, 2019 1 commit
- changed long seq length to 512 · 43dd21f7
  Mohammad Shoeybi authored Dec 26, 2019
  
  43dd21f7
25 Dec, 2019 1 commit
- added filtering based on sentence length · 2c58c9b0
  Mohammad Shoeybi authored Dec 24, 2019
  
  2c58c9b0
04 Dec, 2019 1 commit
- minor cleaning · 75a86a1d
  Mohammad Shoeybi authored Dec 03, 2019
  
  75a86a1d
24 Nov, 2019 4 commits
- removed split dataset · 8179ebd3
  Mohammad Shoeybi authored Nov 24, 2019
  
  8179ebd3
- minor fix · 5300c69f
  Mohammad Shoeybi authored Nov 24, 2019
  
  5300c69f
- resolved reproducibity issue · e2add0fd
  Mohammad Shoeybi authored Nov 24, 2019
  
  e2add0fd
- zero worker seems to be working · 0601702a
  Mohammad Shoeybi authored Nov 24, 2019
  
  0601702a
21 Nov, 2019 1 commit
- fixed padding issue · f6a6811f
  Mohammad Shoeybi authored Nov 20, 2019
  
  f6a6811f
20 Nov, 2019 2 commits
- added write option for index map · 9ea9d50f
  Mohammad Shoeybi authored Nov 20, 2019
  
  9ea9d50f
- fixed couple of bugs in helpers · 690291dd
  Mohammad Shoeybi authored Nov 20, 2019
  
  690291dd
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
13 Nov, 2019 1 commit
- Plugging new dataset stuff together. · 0058b1a5
  Jared Casper authored Nov 13, 2019
```
Some cleanup of types, etc. in the helpers cpp code.
```
  0058b1a5
11 Nov, 2019 1 commit
- c++ code working · f51ceb7c
  Mohammad Shoeybi authored Nov 10, 2019
  
  f51ceb7c
09 Nov, 2019 2 commits
- Skip any empty sentences during preprocessing. · 3f4bc91b
  Jared Casper authored Nov 08, 2019
  
  3f4bc91b
- Add ability to take a contiguous slice to indexed_dataset. · 61697cab
  Jared Casper authored Nov 08, 2019
```
Also removed the fix_lua_indexing stuff from fairseq.
```
  61697cab
08 Nov, 2019 3 commits
- before optimization · 6140718f
  Mohammad Shoeybi authored Nov 08, 2019
  
  6140718f
- built simple test for dataset · c125d247
  Mohammad Shoeybi authored Nov 07, 2019
  
  c125d247
- added dataset · 7120e931
  Mohammad Shoeybi authored Nov 07, 2019
  
  7120e931