Commits · 2bd27e205230d61d6dbc07b49d409b2d0cebd62d · OpenDAS / Megatron-LM

18 Sep, 2020 1 commit
- scaling-generalized masking-softmax fusion kernel · d73def35
  root authored Sep 18, 2020
  
  d73def35
11 Sep, 2020 1 commit
- Various speed optimizations. · 51a2e6b0
  Vijay Korthikanti authored Sep 11, 2020
  
  51a2e6b0
03 Sep, 2020 1 commit
- debuged the cpu init for mp=1 · 04cd82bd
  mohammad authored Sep 03, 2020
  
  04cd82bd
02 Sep, 2020 2 commits
- addressed Jareds comments · 5d29769c
  mohammad authored Sep 02, 2020
  
  5d29769c
- added splitting checkpointed activations · d6c4248b
  mohammad authored Sep 02, 2020
  
  d6c4248b
28 Aug, 2020 1 commit
- Added documentation · b6b48a32
  Boris Fomitchev authored Aug 27, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  b6b48a32
27 Aug, 2020 1 commit
- Addressing code review comments · 1eafa861
  Boris Fomitchev authored Aug 26, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  1eafa861
26 Aug, 2020 1 commit
- Making --lazy_mpu_init act as _USE_CPU_INITIALIZATION · e10760ea
  Boris Fomitchev authored Aug 26, 2020
  
  e10760ea
25 Aug, 2020 1 commit
- Making onnx-safe option overrideable · d4bb6cb0
  Boris Fomitchev authored Aug 25, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  d4bb6cb0
07 Aug, 2020 3 commits
- pip update · 8ad2af6d
  Evelina authored Aug 07, 2020
```
Signed-off-by: Evelina <ebakhturina@nvidia.com>
```
  8ad2af6d
- comment fix · 4e8ace9b
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  4e8ace9b
- fixed typo in comment · 39c80331
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  39c80331
06 Aug, 2020 3 commits
- Addressing code review comments · c632d205
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  c632d205
- Removed assert in case of external ddp, exported initialize_megatron() · be842037
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  be842037
- Implementing lazy parallel initialization · 5c04ceb3
  Boris Fomitchev authored Aug 05, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  5c04ceb3
04 Aug, 2020 1 commit
- pip version update · 3b9ea79c
  Evelina authored Aug 04, 2020
```
Signed-off-by: Evelina <ebakhturina@nvidia.com>
```
  3b9ea79c
03 Aug, 2020 1 commit
- added gpu initialization and option to avoid master values · 0403b808
  mohammad authored Aug 03, 2020
  
  0403b808
31 Jul, 2020 1 commit
- Code review comments - changing parallel test condition · 35bea728
  Boris Fomitchev authored Jul 30, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  35bea728
30 Jul, 2020 2 commits
- Remove spurious imports · 33a666d4
  Neel Kant authored Jul 30, 2020
  
  33a666d4
- Changes for NeMo/lightning compatibility · 417c7f6a
  Boris Fomitchev authored Jul 30, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  417c7f6a
29 Jul, 2020 1 commit
- Restored @script for openai_gelu · bb7c638f
  Boris Fomitchev authored Jul 29, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  bb7c638f
28 Jul, 2020 1 commit
- Replacing --erf-gelu option with explicit --onnx-safe option · fe794c5a
  Boris Fomitchev authored Jul 27, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  fe794c5a
26 Jul, 2020 3 commits
- Add additional assertion on Indexer to test correctness, and limit verbosity in other classes · eaa5d877
  Neel Kant authored Jul 25, 2020
  
  eaa5d877
- fixing copy-paste · 7917774a
  Boris Fomitchev authored Jul 25, 2020
  
  7917774a
- Complete fix for APEX absence in NeMo · aa0ee72e
  Boris Fomitchev authored Jul 25, 2020
  
  aa0ee72e
24 Jul, 2020 3 commits
- Fixed APEX test · 8f0af7cd
  Boris Fomitchev authored Jul 24, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  8f0af7cd
- Warning added · b04eb0a2
  Boris Fomitchev authored Jul 23, 2020
  
  b04eb0a2
- ONNX export fix, including one for gelu() · 158a99c3
  Boris Fomitchev authored Jul 23, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  158a99c3
23 Jul, 2020 1 commit
- Address comments from last week · 11f76cd3
  Neel Kant authored Jul 22, 2020
  
  11f76cd3
22 Jul, 2020 1 commit
- Initialization fixes: allowing simple case like pytest pass, also making apex optional · 9026b86d
  Boris Fomitchev authored Jul 22, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  9026b86d
14 Jul, 2020 2 commits
- Fix gpt2_dataset import error · 5247f24c
  Neel Kant authored Jul 14, 2020
  
  5247f24c
- Additional refactoring · b9bd1a11
  Neel Kant authored Jul 13, 2020
  
  b9bd1a11
07 Jul, 2020 2 commits
- Made topk accuracy reporting optional · de6640be
  Neel Kant authored Jul 07, 2020
  
  de6640be
- Addressed Jared's comments · 8d7f508a
  Neel Kant authored Jul 06, 2020
  
  8d7f508a
04 Jul, 2020 1 commit
- small fix for CheckpointFunction's backward() method when sone args may be NoneType · 4ee0537a
  Devendra Singh Sachan authored Jul 04, 2020
  
  4ee0537a
02 Jul, 2020 1 commit
- One sentence options · 03feecbc
  Neel Kant authored Jul 02, 2020
  
  03feecbc
30 Jun, 2020 1 commit
- adding realm_index.py · d9d4ce70
  Neel Kant authored Jun 30, 2020
  
  d9d4ce70
29 Jun, 2020 2 commits
- Create tensors on cuda rather than copying · 76928caa
  Neel Kant authored Jun 29, 2020
  
  76928caa
- Changes after running on draco · 44860f8d
  Neel Kant authored Jun 28, 2020
  
  44860f8d
28 Jun, 2020 1 commit
- remove data/preprocess_data.py · 8f3f338a
  Neel Kant authored Jun 27, 2020
  
  8f3f338a