- 11 Aug, 2023 1 commit
-
-
Haonan Li authored
-
- 10 Aug, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 08 Aug, 2023 1 commit
-
-
Stella Biderman authored
Removes the `_remove_prefixes` optimization as it's invalid for exact match metrics. Closes https://github.com/EleutherAI/lm-evaluation-harness/issues/726
-
- 27 Jul, 2023 6 commits
-
-
GUIJIN SON authored
-
GUIJIN SON authored
-
GUIJIN SON authored
-
GUIJIN SON authored
-
GUIJIN SON authored
-
GUIJIN SON authored
-
- 17 Jul, 2023 3 commits
-
-
guijinSON authored
-
Hailey Schoelkopf authored
-
guijinSON authored
-
- 16 Jul, 2023 2 commits
- 13 Jul, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 08 Jul, 2023 1 commit
-
-
hyz's github authored
-
- 03 Jul, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 27 Jun, 2023 1 commit
-
-
Hailey Schoelkopf authored
-
- 21 Jun, 2023 1 commit
-
-
Guillaume "Vermeille" Sanchez authored
-
- 14 Jun, 2023 2 commits
-
-
Hailey Schoelkopf authored
-
Hailey Schoelkopf authored
-
- 07 Jun, 2023 1 commit
-
-
Oleh Shliazhko authored
-
- 06 Jun, 2023 1 commit
-
-
Oleh Shliazhko authored
-
- 28 May, 2023 1 commit
-
-
Oleh Shliazhko authored
-
- 26 May, 2023 1 commit
-
-
seopbo authored
-
- 25 May, 2023 1 commit
-
-
Jeffrey Quesnelle authored
-
- 23 May, 2023 2 commits
-
-
lintangsutawika authored
-
lintangsutawika authored
-
- 20 May, 2023 1 commit
-
-
Niklas Muennighoff authored
-
- 12 May, 2023 2 commits
-
-
Oleh Shliazhko authored
-
Oleh Shliazhko authored
-
- 11 May, 2023 1 commit
-
-
Julen Etxaniz authored
* add xcopa dataset * add xstory_cloze dataset and run pre-commit * fix xcopa validation and test sets * add xwinograd dataset * add pawsx task * add xnli task * update task table with recently added tasks * remove unused metrics from paws-x * add mgsm task and fix gsm8k * fix gsm8k until * update task table
-
- 08 May, 2023 1 commit
-
-
janEbert authored
-
- 28 Apr, 2023 1 commit
-
-
yurodiviy authored
* Support bigbench-hard json tasks using multiple_choice_grade * Add support for greedy decoding in bigbench tasks * move bigbench_resources to datasets * rectify changes to rf.greedy_until w upstream * make path to resource import reflect new location --------- Co-authored-by:haileyschoelkopf <hailey.schoelkopf@yale.edu>
-
- 10 Mar, 2023 1 commit
-
-
ben authored
* host wikitext on hf * transfer wikitext to Eleuther HF org
-
- 09 Mar, 2023 1 commit
-
-
Benjamin Fattori authored
-
- 08 Mar, 2023 3 commits
-
-
Benjamin Fattori authored
-
Benjamin Fattori authored
-
Benjamin Fattori authored
-
- 12 Feb, 2023 1 commit
-
-
Niklas Muennighoff authored
-