Commits · 8ad2af6d8e4c47d30a6ebc1000102151f6610efa · wuxk1 / Megatron-LM

"examples/nlp/vscode:/vscode.git/clone" did not exist on "d9a5acbddc03cf9c4a5b01869fc3c51f463d36a1"

07 Aug, 2020 5 commits
- pip update · 8ad2af6d
  Evelina authored Aug 07, 2020
```
Signed-off-by: Evelina <ebakhturina@nvidia.com>
```
  8ad2af6d
- Merge branch 'optimize_initialization' into 'main' · 5ba627ec
  Jared Casper authored Aug 07, 2020
```
added gpu initialization and option to avoid master values for initialization

See merge request ADLR/megatron-lm!105
```
  5ba627ec
- Merge branch 'parallel-nemo' into 'main' · 0a74547c
  Jared Casper authored Aug 07, 2020
```
Changes for NeMo/lightning compatibility

See merge request ADLR/megatron-lm!104
```
  0a74547c
- comment fix · 4e8ace9b
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  4e8ace9b
- fixed typo in comment · 39c80331
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  39c80331
06 Aug, 2020 4 commits
- Addressing code review comments · c632d205
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  c632d205
- Removed assert in case of external ddp, exported initialize_megatron() · be842037
  Boris Fomitchev authored Aug 06, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  be842037
- Merge remote-tracking branch 'upstream/master' into parallel-nemo · 323c124d
  Boris Fomitchev authored Aug 05, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  323c124d
- Implementing lazy parallel initialization · 5c04ceb3
  Boris Fomitchev authored Aug 05, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  5c04ceb3
04 Aug, 2020 2 commits
- Merge branch 'pip_update' into 'master' · bdc52c19
  Mohammad Shoeybi authored Aug 04, 2020
```
pip version update

See merge request ADLR/megatron-lm!107
```
  bdc52c19
- pip version update · 3b9ea79c
  Evelina authored Aug 04, 2020
```
Signed-off-by: Evelina <ebakhturina@nvidia.com>
```
  3b9ea79c
03 Aug, 2020 1 commit
- added gpu initialization and option to avoid master values · 0403b808
  mohammad authored Aug 03, 2020
  
  0403b808
31 Jul, 2020 4 commits
- Merge remote-tracking branch 'upstream/master' into parallel-nemo · cf9bdadc
  Boris Fomitchev authored Jul 31, 2020
  
  cf9bdadc
- Merge branch 'onnx-erf' into 'master' · 61f50c45
  Jared Casper authored Jul 31, 2020
```
ONNX export fix, including one for gelu()

See merge request ADLR/megatron-lm!101
```
  61f50c45
- Merge branch 'indexer-merge' into 'master' · 4ac91436
  Jared Casper authored Jul 31, 2020
```
REALM indexer and index data structures

See merge request ADLR/megatron-lm!96
```
  4ac91436
- Code review comments - changing parallel test condition · 35bea728
  Boris Fomitchev authored Jul 30, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  35bea728
30 Jul, 2020 2 commits
- Remove spurious imports · 33a666d4
  Neel Kant authored Jul 30, 2020
  
  33a666d4
- Changes for NeMo/lightning compatibility · 417c7f6a
  Boris Fomitchev authored Jul 30, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  417c7f6a
29 Jul, 2020 3 commits
- Merge remote-tracking branch 'upstream/master' into onnx-erf · 84a5997a
  Boris Fomitchev authored Jul 29, 2020
  
  84a5997a
- Restored @script for openai_gelu · bb7c638f
  Boris Fomitchev authored Jul 29, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  bb7c638f
- Merge branch 'apex-fix2' into 'master' · 07ebf714
  Jared Casper authored Jul 29, 2020
```
Complete fix for APEX absence in NeMo

See merge request ADLR/megatron-lm!103
```
  07ebf714
28 Jul, 2020 1 commit
- Replacing --erf-gelu option with explicit --onnx-safe option · fe794c5a
  Boris Fomitchev authored Jul 27, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  fe794c5a
26 Jul, 2020 3 commits
- Add additional assertion on Indexer to test correctness, and limit verbosity in other classes · eaa5d877
  Neel Kant authored Jul 25, 2020
  
  eaa5d877
- fixing copy-paste · 7917774a
  Boris Fomitchev authored Jul 25, 2020
  
  7917774a
- Complete fix for APEX absence in NeMo · aa0ee72e
  Boris Fomitchev authored Jul 25, 2020
  
  aa0ee72e
24 Jul, 2020 5 commits
- Merge branch 'apex-fix-fix' into 'master' · 7feb02c6
  Jared Casper authored Jul 24, 2020
```
Fixed APEX test

See merge request ADLR/megatron-lm!102
```
  7feb02c6
- Fixed APEX test · 8f0af7cd
  Boris Fomitchev authored Jul 24, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  8f0af7cd
- Merge branch 'apex-fix' into 'master' · bf97f933
  Jared Casper authored Jul 24, 2020
```
Initialization fixes: allowing simple case like pytest pass, also making apex optional

See merge request ADLR/megatron-lm!99
```
  bf97f933
- Warning added · b04eb0a2
  Boris Fomitchev authored Jul 23, 2020
  
  b04eb0a2
- ONNX export fix, including one for gelu() · 158a99c3
  Boris Fomitchev authored Jul 23, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  158a99c3
23 Jul, 2020 2 commits
- Add more documentation · c2a32e12
  Neel Kant authored Jul 22, 2020
  
  c2a32e12
- Address comments from last week · 11f76cd3
  Neel Kant authored Jul 22, 2020
  
  11f76cd3
22 Jul, 2020 1 commit
- Initialization fixes: allowing simple case like pytest pass, also making apex optional · 9026b86d
  Boris Fomitchev authored Jul 22, 2020
```
Signed-off-by: Boris Fomitchev <bfomitchev@nvidia.com>
```
  9026b86d
14 Jul, 2020 7 commits
- Merge branch 'master' into indexer-merge · 7a348580
  Neel Kant authored Jul 14, 2020
  
  7a348580
- Merge branch 'ict-merge' into 'master' · 05620ee4
  Neel Kant authored Jul 14, 2020
```
ICT code

See merge request ADLR/megatron-lm!90
```
  05620ee4
- Fix gpt2_dataset import error · 5247f24c
  Neel Kant authored Jul 14, 2020
  
  5247f24c
- Additional refactoring · b9bd1a11
  Neel Kant authored Jul 13, 2020
  
  b9bd1a11
- Merge ict-merge into indexer-merge · ca0cdfaa
  Neel Kant authored Jul 13, 2020
  
  ca0cdfaa
- Merge branch 'master' into ict-merge · a5bfc013
  Neel Kant authored Jul 13, 2020
  
  a5bfc013
- Use the new allgather implementation · 628bf0dd
  Neel Kant authored Jul 13, 2020
  
  628bf0dd