Commits · e5034150abbefec6fd3565d2a3afe7ec9f840529 · OpenDAS / Megatron-LM

15 Jul, 2022 1 commit
- fix pipeline parallel for beam search · e5034150
  peng xu authored Jul 15, 2022
  
  e5034150
25 May, 2022 1 commit
- separate file for license · da11c982
  Peng Xu authored May 25, 2022
  
  da11c982
16 May, 2022 1 commit
- Fixing beam search in distributed mode · 6be75e2a
  rprenger authored May 16, 2022
  
  6be75e2a
05 May, 2022 1 commit
- Making the API talk to the server, fixed a bug where parameters weren't getting forwarded to node · fd176a90
  rprenger authored May 04, 2022
  
  fd176a90
04 May, 2022 2 commits
- final version · 5a570bd8
  peng xu authored May 03, 2022
  
  5a570bd8
- rename hyp and allow return multiple samples · 96816d3d
  peng xu authored May 03, 2022
  
  96816d3d
14 Apr, 2022 1 commit
- fix beam search · 4f579b55
  Peng Xu authored Apr 14, 2022
  
  4f579b55
19 Feb, 2022 2 commits
- Possibly working beam search · de84b2af
  rprenger authored Feb 18, 2022
  
  de84b2af
- Almost working beam search · fa75238b
  rprenger authored Feb 18, 2022
  
  fa75238b
11 Feb, 2022 1 commit
- Addressing comments · 1d391bba
  rprenger authored Feb 10, 2022
  
  1d391bba
08 Feb, 2022 1 commit
- fixed t5 'get_num_layers()' · 2fadaa50
  Lawrence McAfee authored Feb 08, 2022
  
  2fadaa50
04 Feb, 2022 3 commits
- renamed argument; 'embed' -> 'embedding' · c04c4977
  Lawrence McAfee authored Feb 04, 2022
  
  c04c4977
- Adding message to ValueError · b0c824d9
  rprenger authored Feb 04, 2022
  
  b0c824d9
- Adding the web interface · 42982fc3
  rprenger authored Feb 03, 2022
  
  42982fc3
01 Feb, 2022 2 commits
- comments, cleanup. · b93bef00
  Lawrence McAfee authored Feb 01, 2022
  
  b93bef00
- found root source of t5 issue (fast layer norm) · bea16fa3
  Lawrence McAfee authored Feb 01, 2022
  
  bea16fa3
31 Jan, 2022 2 commits
- working for t5 [ encoder embedding only ] · 3af6725d
  Lawrence McAfee authored Jan 31, 2022
  
  3af6725d
- added 'no-op' layer, to replace transformer layer when num_layers == 0. · 1fa6990c
  Lawrence McAfee authored Jan 31, 2022
  
  1fa6990c
29 Jan, 2022 3 commits
- narrowed issue to pipeline rank 0, virtual pipeline rank >= 1 · 5bc9f889
  Lawrence McAfee authored Jan 28, 2022
  
  5bc9f889
- typo fix · 2b628f96
  Vijay Korthikanti authored Jan 28, 2022
  
  2b628f96
- Revert incorrect fix. · cd499559
  Jared Casper authored Jan 28, 2022
  
  cd499559
28 Jan, 2022 2 commits
- more naming cleanup · 641408f5
  Vijay Korthikanti authored Jan 28, 2022
  
  641408f5
- changing class name AnnealingLR to OptimizerParamScheduler · 04ecc834
  Vijay Korthikanti authored Jan 28, 2022
  
  04ecc834
27 Jan, 2022 2 commits
- address review comments · 53931b8b
  Vijay Korthikanti authored Jan 27, 2022
  
  53931b8b
- Adding the option to not log · 31fd62d6
  rprenger authored Jan 26, 2022
  
  31fd62d6
26 Jan, 2022 2 commits
- further clarified viewless tensor comment in transformer.py · d16e2a24
  Lawrence McAfee authored Jan 26, 2022
  
  d16e2a24
- address review comments · 8acbbe25
  Vijay Korthikanti authored Jan 26, 2022
  
  8acbbe25
25 Jan, 2022 2 commits
- limit 'make_viewless_tensor()' to case of micro_batch_size == 1; added comment · 24369dd6
  Lawrence McAfee authored Jan 25, 2022
  
  24369dd6
- working with interleaving · 804ed2e6
  Lawrence McAfee authored Jan 24, 2022
  
  804ed2e6
24 Jan, 2022 4 commits
- added args.transformer_pipeline_model_parallel_size · a06af061
  Lawrence McAfee authored Jan 24, 2022
  
  a06af061
- fixed args.virtual_pipeline_model_parallel_size · c2b7d0b3
  Lawrence McAfee authored Jan 24, 2022
  
  c2b7d0b3
- minor fixes · 7e810e41
  Vijay Korthikanti authored Jan 24, 2022
  
  7e810e41
- working when no interleaving · 33dc8e9c
  Lawrence McAfee authored Jan 24, 2022
  
  33dc8e9c
22 Jan, 2022 1 commit
- second phase of vision code merge · d8c85650
  Vijay Korthikanti authored Jan 21, 2022
  
  d8c85650
20 Jan, 2022 1 commit
- address review comments · 798b6a64
  Vijay Korthikanti authored Jan 20, 2022
  
  798b6a64
19 Jan, 2022 2 commits
- using all_gather instead of gather (nccl does not support gather) · b037a69e
  Vijay Korthikanti authored Jan 19, 2022
  
  b037a69e
- flag for data parallel random initialization · a7ee77ea
  Vijay Korthikanti authored Jan 19, 2022
  
  a7ee77ea
15 Jan, 2022 2 commits
- minor fix · fd8dd9c0
  Vijay Korthikanti authored Jan 14, 2022
  
  fd8dd9c0
- checkpointing rng_state of all data parallel ranks · 09d38884
  Vijay Korthikanti authored Jan 14, 2022
  
  09d38884
14 Jan, 2022 1 commit
- address review comments · 343dc97a
  Vijay Korthikanti authored Jan 14, 2022
  
  343dc97a