1. 15 Feb, 2022 1 commit
  2. 13 Feb, 2022 1 commit
  3. 12 Feb, 2022 1 commit
  4. 06 Feb, 2022 1 commit
  5. 23 Jan, 2022 2 commits
  6. 13 Jan, 2022 1 commit
  7. 11 Jan, 2022 2 commits
  8. 08 Jan, 2022 4 commits
  9. 04 Jan, 2022 1 commit
  10. 03 Jan, 2022 1 commit
  11. 02 Jan, 2022 1 commit
  12. 31 Dec, 2021 2 commits
  13. 30 Dec, 2021 1 commit
  14. 29 Dec, 2021 4 commits
  15. 27 Dec, 2021 1 commit
  16. 26 Dec, 2021 4 commits
  17. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  18. 24 Dec, 2021 6 commits
  19. 23 Dec, 2021 3 commits
  20. 22 Dec, 2021 1 commit
  21. 21 Dec, 2021 1 commit