Commits · 5f2cb263fbf6d8ef4324e1f553fde362e2ba9082 · OpenDAS / Megatron-LM

12 Jul, 2021 1 commit
- updated data processing readme · 5f2cb263
  Mostofa Patwary authored Jul 12, 2021
  
  5f2cb263
19 May, 2021 1 commit
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
14 May, 2021 1 commit
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
21 Apr, 2021 1 commit
- addressed reviews · 0fa728ac
  Mostofa Patwary authored Apr 21, 2021
  
  0fa728ac
20 Apr, 2021 2 commits
- added more comments · f938e19a
  Mostofa Patwary authored Apr 20, 2021
  
  f938e19a
- added more comments · c49b4644
  Mostofa Patwary authored Apr 20, 2021
  
  c49b4644
02 Apr, 2021 1 commit
- More features added · d413bd5f
  Mostofa Patwary authored Apr 01, 2021
  
  d413bd5f
01 Apr, 2021 1 commit
- updated filter_ngrams.py · f559787d
  Mostofa Patwary authored Mar 31, 2021
  
  f559787d
30 Mar, 2021 1 commit
- fix one more issue · 0c01c2fe
  Mostofa Patwary authored Mar 29, 2021
  
  0c01c2fe
26 Mar, 2021 1 commit
- added parallelism for computing jaccard similaity · 43d307d5
  mpatwary authored Mar 25, 2021
  
  43d307d5
24 Mar, 2021 2 commits
- Fixing text generation and zeroshot eval and addressing comments. · 64a83fb5
  Jared Casper authored Mar 24, 2021
  
  64a83fb5
- Tasks seems to be working. · b938ec51
  Jared Casper authored Mar 23, 2021
  
  b938ec51
19 Mar, 2021 1 commit
- Added more feature in train data deduplication · 882683dc
  Mostofa Patwary authored Mar 19, 2021
  
  882683dc
08 Mar, 2021 1 commit
- Added code to cleanup and fix code · 47e7eb80
  Mostofa Patwary authored Mar 08, 2021
  
  47e7eb80
05 Mar, 2021 3 commits
- Fixed a bug · 9c2eb971
  Mostofa Patwary authored Mar 05, 2021
  
  9c2eb971
- Many more features added · b35e15f2
  Mostofa Patwary authored Mar 04, 2021
  
  b35e15f2
- Many more features added · c44f7622
  Mostofa Patwary authored Mar 04, 2021
  
  c44f7622
02 Mar, 2021 1 commit
- Dedup for other tasks added · 6013e23c
  Mostofa Patwary authored Mar 02, 2021
  
  6013e23c
26 Feb, 2021 3 commits
- Updated readme · b08b5edc
  Mostofa Patwary authored Feb 26, 2021
  
  b08b5edc
- added threads · a29890c3
  Mostofa Patwary authored Feb 26, 2021
  
  a29890c3
- Other tasks dedup added · 90c9e3f2
  Mostofa Patwary authored Feb 25, 2021
  
  90c9e3f2
23 Feb, 2021 1 commit
- Added code for building embeddings and savings · bcd605f8
  Mostofa Patwary authored Feb 23, 2021
  
  bcd605f8
22 Feb, 2021 1 commit
- addressed the comments · ebc4a408
  Mostofa Patwary authored Feb 22, 2021
  
  ebc4a408
19 Feb, 2021 4 commits
- updated the readme · 5a867963
  Mostofa Patwary authored Feb 19, 2021
  
  5a867963
- now multiple pickle files can be added · 4b821fb5
  Mostofa Patwary authored Feb 19, 2021
  
  4b821fb5
- Added an example · f6ddeca0
  Mostofa Patwary authored Feb 18, 2021
  
  f6ddeca0
- added storing and loading of pickle file of hash · 2f6e46bd
  Mostofa Patwary authored Feb 18, 2021
  
  2f6e46bd
18 Feb, 2021 1 commit
- added readme · a449d312
  Mostofa Patwary authored Feb 18, 2021
  
  a449d312
17 Feb, 2021 2 commits
- filtering n-grams · 59372322
  Mostofa Patwary authored Feb 17, 2021
  
  59372322
- Fixed a minor bug · 0a158128
  Mostofa Patwary authored Feb 17, 2021
  
  0a158128
10 Feb, 2021 1 commit
- started evaluation of ICT · 613d0fe8
  Mostofa Patwary authored Feb 09, 2021
  
  613d0fe8
08 Feb, 2021 1 commit
- Improve handling of rng states in checkpoints. · 08a848c7
  Jared Casper authored Feb 08, 2021
  
  08a848c7
02 Feb, 2021 1 commit
- Fix bug in merge_mp_partitions for handling recent checkpoints. · 72105ef0
  Jared Casper authored Feb 02, 2021
  
  72105ef0
01 Feb, 2021 1 commit
- Handle empty documents in preprocess_data. · 09d220cf
  Jared Casper authored Feb 01, 2021
  
  09d220cf
28 Jan, 2021 1 commit
- Improve comments around layer regex replacement. · 98a5b9a0
  Jared Casper authored Jan 28, 2021
  
  98a5b9a0
27 Jan, 2021 2 commits
- Move rearranging query_key_value and key_value values in old checkpoints to... · 76960d7c
  Jared Casper authored Jan 27, 2021
```
Move rearranging query_key_value and key_value values in old checkpoints to when the checkpoint is loaded instead of runtime..
```
  76960d7c
- Teach merge_mp_partitions how to write out a pipelined model. · 7cabbe67
  Jared Casper authored Jan 27, 2021
  
  7cabbe67
25 Jan, 2021 1 commit
- Address comments, fix argument bug. · bdd47d64
  Jared Casper authored Jan 25, 2021
  
  bdd47d64
22 Jan, 2021 1 commit
- Fixing merge_mp_partitions · 78066ab0
  Jared Casper authored Jan 20, 2021
  
  78066ab0
12 Jan, 2021 1 commit
- Readme update + change gpt2 to gpt · 152aab30
  Mohammad Shoeybi authored Jan 11, 2021
  
  152aab30