1. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  2. 09 Dec, 2021 1 commit
  3. 05 Dec, 2021 1 commit
  4. 29 Nov, 2021 5 commits
  5. 24 Nov, 2021 2 commits
  6. 19 Nov, 2021 1 commit
  7. 16 Nov, 2021 1 commit
  8. 06 Nov, 2021 1 commit
  9. 05 Nov, 2021 3 commits
  10. 04 Nov, 2021 3 commits
  11. 03 Nov, 2021 1 commit
  12. 31 Oct, 2021 2 commits
  13. 30 Oct, 2021 1 commit
  14. 11 Oct, 2021 1 commit
  15. 07 Oct, 2021 1 commit
  16. 06 Oct, 2021 2 commits
  17. 30 Sep, 2021 1 commit
  18. 29 Sep, 2021 2 commits
  19. 25 Sep, 2021 1 commit
  20. 03 Sep, 2021 1 commit
  21. 01 Sep, 2021 1 commit
  22. 31 Aug, 2021 1 commit
  23. 28 Aug, 2021 1 commit
  24. 27 Aug, 2021 1 commit
  25. 26 Aug, 2021 2 commits
  26. 15 Aug, 2021 1 commit
  27. 13 Aug, 2021 1 commit