1. 08 May, 2023 1 commit
  2. 02 May, 2023 2 commits
  3. 24 Apr, 2023 1 commit
  4. 19 Apr, 2023 1 commit
  5. 03 May, 2022 1 commit
  6. 29 Apr, 2022 1 commit
  7. 27 Apr, 2022 1 commit
  8. 26 Apr, 2022 1 commit
  9. 18 Mar, 2022 1 commit
  10. 29 Dec, 2021 1 commit
  11. 25 Dec, 2021 1 commit
    • Igor Ostrovsky's avatar
      Fix bits_per_byte metric in PerplexityTask · 38360512
      Igor Ostrovsky authored
      bits_per_byte was calculated as average per-byte loglikelihood, which would work if loglikelihood was base-2 log,
      but it is natural log. To correct for that, bits_per_byte should be divided by math.log(2).
      
      Also, it should be true that 2^bits_per_byte == byte_perplexity, which is true after the fix.
      38360512
  12. 24 Nov, 2021 1 commit
  13. 11 May, 2021 3 commits
  14. 10 May, 2021 4 commits
  15. 05 May, 2021 1 commit
  16. 03 May, 2021 2 commits
  17. 02 May, 2021 2 commits
  18. 29 Mar, 2021 1 commit
  19. 27 Mar, 2021 1 commit
  20. 14 Feb, 2021 1 commit
  21. 12 Feb, 2021 3 commits