Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
9350ee08836cc7ddfa28206ecfb6110e0a1fcaf9
Switch branch/tag
megatron-lm
megatron
03 Apr, 2020
5 commits
Remove commented out test code
· 9238c57a
Neel Kant
authored
Apr 03, 2020
9238c57a
Fix InverseClozeDataset behavior (with commented out test code)
· ca6b6687
Neel Kant
authored
Apr 03, 2020
ca6b6687
sample generation runs
· fffa0497
Mohammad
authored
Apr 02, 2020
fffa0497
code runs
· 752eeae3
Mohammad
authored
Apr 02, 2020
752eeae3
working on refactoring text generation
· ce29d4d5
Mohammad
authored
Apr 02, 2020
ce29d4d5
02 Apr, 2020
2 commits
some changes to args
· 2bd6196c
Mohammad
authored
Apr 02, 2020
2bd6196c
refactored evaluate_gpt2
· 8fae1cdd
Mohammad
authored
Apr 01, 2020
8fae1cdd
01 Apr, 2020
2 commits
addressed comments from raul, neel, and jared
· bf3ce751
Mohammad
authored
Apr 01, 2020
bf3ce751
Bugfix and remove unneeded script
· 423c51b0
Neel Kant
authored
Mar 31, 2020
423c51b0
31 Mar, 2020
5 commits
Make InverseClozeDataset more efficient
· e949a5c5
Neel Kant
authored
Mar 31, 2020
e949a5c5
Add while condition to InverseClozeDataset to protect against corner cases
· 6e856fac
Neel Kant
authored
Mar 31, 2020
6e856fac
Remove debug statements and correct dataloader
· 6f56b909
Neel Kant
authored
Mar 31, 2020
6f56b909
deprecated data_utils
· 8600642e
Mohammad
authored
Mar 31, 2020
8600642e
arguments in the model refactored
· deffcb6a
Mohammad
authored
Mar 31, 2020
deffcb6a
30 Mar, 2020
8 commits
removed unused values in samplers
· 259062c2
Mohammad
authored
Mar 30, 2020
259062c2
added samplers from data_utils
· 32e1ddb0
Mohammad
authored
Mar 30, 2020
32e1ddb0
Add debug statements
· f1b2524b
Neel Kant
authored
Mar 30, 2020
f1b2524b
removed building tokenizer from bert dataset
· dedb2ef7
Mohammad
authored
Mar 30, 2020
dedb2ef7
both bert and gpt2 tested and working
· 1788c910
Mohammad
authored
Mar 29, 2020
1788c910
both bert and gpt are working
· 5f8623db
Mohammad
authored
Mar 29, 2020
5f8623db
added gpt2 tokenizer
· 46379244
Mohammad
authored
Mar 29, 2020
46379244
added gpt2 tokenizer
· 0e5dfd7f
Mohammad
authored
Mar 29, 2020
0e5dfd7f
29 Mar, 2020
4 commits
refactored learning-rate
· b6e0377b
Mohammad
authored
Mar 29, 2020
b6e0377b
refactored training
· 27e14f82
Mohammad
authored
Mar 28, 2020
27e14f82
utils partially refactored and tested
· 3f58649b
Mohammad
authored
Mar 28, 2020
3f58649b
refactored checkpooints but not tested yet
· 86e7d624
Mohammad
authored
Mar 28, 2020
86e7d624
28 Mar, 2020
4 commits
tokenizer moved to its own directory
· 11220df8
Mohammad
authored
Mar 28, 2020
11220df8
working on utils
· 5050203f
Mohammad
authored
Mar 28, 2020
5050203f
arguments.py refactored
· 94e2ca57
Mohammad
authored
Mar 27, 2020
94e2ca57
added initialize megatron
· a9e19f8e
Mohammad
authored
Mar 27, 2020
a9e19f8e
27 Mar, 2020
3 commits
added global variables
· 83aa9219
Mohammad
authored
Mar 27, 2020
83aa9219
pretrain_bert_icy.py compiles and runs
· 1dd51c0e
Neel Kant
authored
Mar 27, 2020
1dd51c0e
working on bert
· 599e959a
Mohammad
authored
Mar 26, 2020
599e959a
26 Mar, 2020
5 commits
Modify pretrain_bert_ict.py to work with ICTBertModel
· b1efc33d
Neel Kant
authored
Mar 26, 2020
b1efc33d
Complete definition of ICTBertModel
· 371d2ea9
Neel Kant
authored
Mar 26, 2020
371d2ea9
Reformat parts of BertModel
· 9873a8da
Neel Kant
authored
Mar 26, 2020
9873a8da
Create ICTBertModel and update model/.__init__.py
· fd33e930
Neel Kant
authored
Mar 26, 2020
fd33e930
Add ICT-related parameters to BertModel
· bcb320ee
Neel Kant
authored
Mar 26, 2020
bcb320ee
24 Mar, 2020
2 commits
Correct some args and create pretrain_bert_ict.py
· 21a916b1
Neel Kant
authored
Mar 24, 2020
21a916b1
Complete __getitem__ for InverseClozeDataset
· d2eabecb
Neel Kant
authored
Mar 24, 2020
d2eabecb
