1. 18 May, 2023 1 commit
  2. 02 Aug, 2022 1 commit
  3. 22 May, 2022 1 commit
  4. 18 Mar, 2022 1 commit
  5. 29 Dec, 2021 1 commit
  6. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  7. 24 Nov, 2021 1 commit
  8. 11 May, 2021 3 commits
  9. 10 May, 2021 4 commits
  10. 05 May, 2021 1 commit
  11. 03 May, 2021 2 commits
  12. 02 May, 2021 2 commits
  13. 29 Mar, 2021 1 commit
  14. 27 Mar, 2021 1 commit
  15. 14 Feb, 2021 1 commit
  16. 12 Feb, 2021 3 commits