Commits · 7a9c4a03fdbc5a235e47feac29839a733101c0c5 · OpenDAS / Megatron-LM

19 Jul, 2021 1 commit
- Removing bug possibilities and adding timing info · 7a9c4a03
  rprenger authored Jul 19, 2021
  
  7a9c4a03
09 Jul, 2021 1 commit
- Refactoring code so server code is more independent of sampling and adding a... · 29dd0a35
  rprenger authored Jul 09, 2021
```
Refactoring code so server code is more independent of sampling and adding a CLI.  CLI still has URL of server hard-coded
```
  29dd0a35
30 Jun, 2021 2 commits
- Removing unnecessary --recompute path · 453414da
  rprenger authored Jun 30, 2021
  
  453414da
- Clean up removing a lot of code. Works with curl people might still want a webpage or CLI · f7fe3865
  rprenger authored Jun 30, 2021
  
  f7fe3865
23 Jun, 2021 1 commit
- Working single sentence version · 2cdebf4b
  rprenger authored Jun 23, 2021
  
  2cdebf4b
19 May, 2021 1 commit
- Fixed issues with ICT pretraining · 7577931b
  Mostofa Patwary authored May 18, 2021
  
  7577931b
14 May, 2021 1 commit
- Add arg needed for tokenizer. · 2c247afb
  Jared Casper authored May 14, 2021
  
  2c247afb
21 Apr, 2021 1 commit
- addressed reviews · 0fa728ac
  Mostofa Patwary authored Apr 21, 2021
  
  0fa728ac
20 Apr, 2021 2 commits
- added more comments · f938e19a
  Mostofa Patwary authored Apr 20, 2021
  
  f938e19a
- added more comments · c49b4644
  Mostofa Patwary authored Apr 20, 2021
  
  c49b4644
02 Apr, 2021 1 commit
- More features added · d413bd5f
  Mostofa Patwary authored Apr 01, 2021
  
  d413bd5f
01 Apr, 2021 1 commit
- updated filter_ngrams.py · f559787d
  Mostofa Patwary authored Mar 31, 2021
  
  f559787d
30 Mar, 2021 1 commit
- fix one more issue · 0c01c2fe
  Mostofa Patwary authored Mar 29, 2021
  
  0c01c2fe
26 Mar, 2021 1 commit
- added parallelism for computing jaccard similaity · 43d307d5
  mpatwary authored Mar 25, 2021
  
  43d307d5
24 Mar, 2021 2 commits
- Fixing text generation and zeroshot eval and addressing comments. · 64a83fb5
  Jared Casper authored Mar 24, 2021
  
  64a83fb5
- Tasks seems to be working. · b938ec51
  Jared Casper authored Mar 23, 2021
  
  b938ec51
19 Mar, 2021 1 commit
- Added more feature in train data deduplication · 882683dc
  Mostofa Patwary authored Mar 19, 2021
  
  882683dc
08 Mar, 2021 1 commit
- Added code to cleanup and fix code · 47e7eb80
  Mostofa Patwary authored Mar 08, 2021
  
  47e7eb80
05 Mar, 2021 3 commits
- Fixed a bug · 9c2eb971
  Mostofa Patwary authored Mar 05, 2021
  
  9c2eb971
- Many more features added · b35e15f2
  Mostofa Patwary authored Mar 04, 2021
  
  b35e15f2
- Many more features added · c44f7622
  Mostofa Patwary authored Mar 04, 2021
  
  c44f7622
02 Mar, 2021 1 commit
- Dedup for other tasks added · 6013e23c
  Mostofa Patwary authored Mar 02, 2021
  
  6013e23c
26 Feb, 2021 3 commits
- Updated readme · b08b5edc
  Mostofa Patwary authored Feb 26, 2021
  
  b08b5edc
- added threads · a29890c3
  Mostofa Patwary authored Feb 26, 2021
  
  a29890c3
- Other tasks dedup added · 90c9e3f2
  Mostofa Patwary authored Feb 25, 2021
  
  90c9e3f2
23 Feb, 2021 1 commit
- Added code for building embeddings and savings · bcd605f8
  Mostofa Patwary authored Feb 23, 2021
  
  bcd605f8
22 Feb, 2021 1 commit
- addressed the comments · ebc4a408
  Mostofa Patwary authored Feb 22, 2021
  
  ebc4a408
19 Feb, 2021 4 commits
- updated the readme · 5a867963
  Mostofa Patwary authored Feb 19, 2021
  
  5a867963
- now multiple pickle files can be added · 4b821fb5
  Mostofa Patwary authored Feb 19, 2021
  
  4b821fb5
- Added an example · f6ddeca0
  Mostofa Patwary authored Feb 18, 2021
  
  f6ddeca0
- added storing and loading of pickle file of hash · 2f6e46bd
  Mostofa Patwary authored Feb 18, 2021
  
  2f6e46bd
18 Feb, 2021 1 commit
- added readme · a449d312
  Mostofa Patwary authored Feb 18, 2021
  
  a449d312
17 Feb, 2021 2 commits
- filtering n-grams · 59372322
  Mostofa Patwary authored Feb 17, 2021
  
  59372322
- Fixed a minor bug · 0a158128
  Mostofa Patwary authored Feb 17, 2021
  
  0a158128
10 Feb, 2021 1 commit
- started evaluation of ICT · 613d0fe8
  Mostofa Patwary authored Feb 09, 2021
  
  613d0fe8
08 Feb, 2021 1 commit
- Improve handling of rng states in checkpoints. · 08a848c7
  Jared Casper authored Feb 08, 2021
  
  08a848c7
02 Feb, 2021 1 commit
- Fix bug in merge_mp_partitions for handling recent checkpoints. · 72105ef0
  Jared Casper authored Feb 02, 2021
  
  72105ef0
01 Feb, 2021 1 commit
- Handle empty documents in preprocess_data. · 09d220cf
  Jared Casper authored Feb 01, 2021
  
  09d220cf
28 Jan, 2021 1 commit
- Improve comments around layer regex replacement. · 98a5b9a0
  Jared Casper authored Jan 28, 2021
  
  98a5b9a0
27 Jan, 2021 1 commit
- Move rearranging query_key_value and key_value values in old checkpoints to... · 76960d7c
  Jared Casper authored Jan 27, 2021
```
Move rearranging query_key_value and key_value values in old checkpoints to when the checkpoint is loaded instead of runtime..
```
  76960d7c