Commits · c9289b900f688b2eae38433a4c62981b58d6ccbb · OpenDAS / Megatron-LM

07 Nov, 2024 1 commit
- update · c9289b90
  liangjing authored Nov 07, 2024
  
  c9289b90
08 Apr, 2020 3 commits
- Rename and organize scripts directory. · 985f027d
  Jared Casper authored Apr 08, 2020
  
  985f027d
- New tools directory. · 3500d036
  Jared Casper authored Apr 08, 2020
  
  3500d036
- Updates to preprocess_data.py and indexed_dataset. · da0562fc
  Jared Casper authored Apr 07, 2020
```
preprocess_data:
- Adds ability to not split sentences. This is used for gpt2 datasets.

- Adds ability to create multiple datasets from different json keys,
this is current untested.

indexed_dataset:
- Add new "get" function to get a portion of an entry.
```
  da0562fc
02 Apr, 2020 3 commits
- some changes to args · 2bd6196c
  Mohammad authored Apr 02, 2020
  
  2bd6196c
- verified zeroshot tasks works · ba2264ab
  Raul Puri authored Apr 02, 2020
  
  ba2264ab
- Add linting script · b07f1d0a
  Neel Kant authored Apr 01, 2020
  
  b07f1d0a
19 Nov, 2019 1 commit
- Plumbing for new albert dataset, including mods to arguments for data loaders. · 1a1cfcff
  Jared Casper authored Nov 18, 2019
  
  1a1cfcff
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290
07 Oct, 2019 1 commit
- Add licence to split script. · 5d402eb4
  Jared Casper authored Oct 07, 2019
  
  5d402eb4
04 Oct, 2019 1 commit
- Updating public repo with latest changes. · a1d04b79
  Jared Casper authored Oct 04, 2019
  
  a1d04b79
12 Sep, 2019 1 commit
- added missing valid-data line (#9) · 93ab4bea
  Raul Puri authored Sep 12, 2019
  
  93ab4bea
30 Jul, 2019 1 commit

large update including model parallelism and gpt2 · abe36e2e

Raul Puri authored Jul 29, 2019


Co-authored-by: shoeybi <shoeybim@gmail.com>
Co-authored-by: raulpuric <raulpuric@berkeley.edu>
Co-authored-by: jaredcasper <jaredcasper@gmail.com>
Co-authored-by: mpatwary <mostofa.patwary@gmail.com>
Co-authored-by: plegresl <plegresl@gmail.com>

abe36e2e

13 May, 2019 1 commit
- added presplit-sentences to scripts · 3573423f
  Raul Puri authored May 13, 2019
  
  3573423f
11 May, 2019 1 commit
- added missing presplit_sentences_json.py · d0878333
  Raul Puri authored May 11, 2019
  
  d0878333
27 Mar, 2019 1 commit
- initial commit · fb4cbdc2
  Raul Puri authored Mar 27, 2019
  
  fb4cbdc2