Commits · 371d2ea9dad262632ebc129c07ca91d738bb4948 · OpenDAS / Megatron-LM

26 Mar, 2020 4 commits
- Complete definition of ICTBertModel · 371d2ea9
  Neel Kant authored Mar 26, 2020
  
  371d2ea9
- Reformat parts of BertModel · 9873a8da
  Neel Kant authored Mar 26, 2020
  
  9873a8da
- Create ICTBertModel and update model/.__init__.py · fd33e930
  Neel Kant authored Mar 26, 2020
  
  fd33e930
- Add ICT-related parameters to BertModel · bcb320ee
  Neel Kant authored Mar 26, 2020
  
  bcb320ee
10 Feb, 2020 1 commit
- Model parallel merger · 57c2060f
  Mohammad Shoeybi authored Feb 10, 2020
  
  57c2060f
14 Jan, 2020 1 commit
- added query-key layer scaling and softmax fp32 option · 691747b1
  Mohammad Shoeybi authored Jan 13, 2020
  
  691747b1
21 Nov, 2019 1 commit
- fixed padding issue · f6a6811f
  Mohammad Shoeybi authored Nov 20, 2019
  
  f6a6811f
29 Oct, 2019 1 commit
- Major refactoring, combining gpt2 and bert · 73af1290
  Mohammad Shoeybi authored Oct 29, 2019
  
  73af1290