Skip to content

GitLab

Switch branch/tag
  1. 08 May, 2019 2 commits
  3. 07 May, 2019 2 commits
  5. 30 Apr, 2019 3 commits
  7. 16 Apr, 2019 1 commit
    • Abhi Sharma's avatar
      Fix gradient overflow issue during attention mask · 9e666aaa
      Abhi Sharma authored 
      This fix is in reference to issue #382. GPT2 can now be trained in mixed precision, which I've confirmed with testing. I also tested unconditional generation on multiple seeds before and after changing 1e10 to 1e4 and there was no difference. Please let me know if there is anything else I can do to make this pull request better. Thanks for all your work!
      9e666aaa
  9. 15 Apr, 2019 3 commits
  11. 27 Mar, 2019 1 commit
  13. 24 Mar, 2019 5 commits
  15. 14 Mar, 2019 1 commit
  17. 06 Mar, 2019 1 commit
  19. 23 Feb, 2019 1 commit
  21. 22 Feb, 2019 1 commit
  23. 18 Feb, 2019 2 commits
  25. 17 Feb, 2019 3 commits
  27. 09 Feb, 2019 1 commit
  29. 08 Feb, 2019 3 commits
  31. 07 Feb, 2019 1 commit
  33. 05 Feb, 2019 1 commit
  35. 29 Jan, 2019 3 commits
  37. 28 Jan, 2019 3 commits
  39. 15 Jan, 2019 1 commit
  41. 08 Jan, 2019 1 commit