1. 23 Jan, 2022 1 commit
  2. 13 Jan, 2022 1 commit
  3. 11 Jan, 2022 2 commits
  4. 08 Jan, 2022 4 commits
  5. 04 Jan, 2022 1 commit
  6. 03 Jan, 2022 1 commit
  7. 02 Jan, 2022 1 commit
  8. 31 Dec, 2021 2 commits
  9. 30 Dec, 2021 1 commit
  10. 29 Dec, 2021 4 commits
  11. 27 Dec, 2021 1 commit
  12. 26 Dec, 2021 4 commits
  13. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  14. 24 Dec, 2021 6 commits
  15. 23 Dec, 2021 3 commits
  16. 22 Dec, 2021 1 commit
  17. 21 Dec, 2021 3 commits
  18. 16 Dec, 2021 3 commits