Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
Megatron-LM
Commits
dedb2ef78cdf54a54b6986ac0e8fc0045dd4fa07
Switch branch/tag
megatron-lm
megatron
tokenizer
tokenizer.py
30 Mar, 2020
3 commits
removed building tokenizer from bert dataset
· dedb2ef7
Mohammad
authored
Mar 30, 2020
dedb2ef7
both bert and gpt are working
· 5f8623db
Mohammad
authored
Mar 29, 2020
5f8623db
added gpt2 tokenizer
· 0e5dfd7f
Mohammad
authored
Mar 29, 2020
0e5dfd7f
28 Mar, 2020
2 commits
tokenizer moved to its own directory
· 11220df8
Mohammad
authored
Mar 28, 2020
11220df8
arguments.py refactored
· 94e2ca57
Mohammad
authored
Mar 27, 2020
94e2ca57
27 Mar, 2020
1 commit
added global variables
· 83aa9219
Mohammad
authored
Mar 27, 2020
83aa9219
24 Mar, 2020
1 commit
BERT downstream tasks: RACE, MNLI, QQP
· 90ef2e28
Mohammad Shoeybi
authored
Mar 23, 2020
90ef2e28