1. 30 Jan, 2022 2 commits
  2. 23 Jan, 2022 1 commit
  3. 13 Jan, 2022 1 commit
  4. 11 Jan, 2022 2 commits
  5. 08 Jan, 2022 4 commits
  6. 04 Jan, 2022 1 commit
  7. 03 Jan, 2022 1 commit
  8. 02 Jan, 2022 1 commit
  9. 31 Dec, 2021 2 commits
  10. 30 Dec, 2021 1 commit
  11. 29 Dec, 2021 4 commits
  12. 27 Dec, 2021 1 commit
  13. 26 Dec, 2021 5 commits
  14. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  15. 24 Dec, 2021 6 commits
  16. 23 Dec, 2021 3 commits
  17. 22 Dec, 2021 1 commit
  18. 21 Dec, 2021 3 commits