Commits · 4de8a74eb4b92654b59a5dabced015b9d35e3672 · gaoqiong / lm-evaluation-harness

09 Mar, 2023 1 commit
- transfer data to eleuther HF org · 7502ff3d
  Benjamin Fattori authored Mar 09, 2023
  
  7502ff3d
08 Mar, 2023 3 commits
- inspect import not needed · db501387
  Benjamin Fattori authored Mar 08, 2023
  
  db501387
- remove unused import for eval-harness · 1581db0b
  Benjamin Fattori authored Mar 08, 2023
  
  1581db0b
- arithmetic task class now uses HF remote builder · 3c8479ba
  Benjamin Fattori authored Mar 08, 2023
  
  3c8479ba
03 May, 2022 1 commit
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 1 commit
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
25 Apr, 2022 1 commit
- Fix coqa · 9484eecc
  jon-tow authored Apr 25, 2022
  
  9484eecc
11 Apr, 2022 1 commit
- Merge changes · 9b4bfb6a
  jon-tow authored Apr 11, 2022
  
  9b4bfb6a
19 Mar, 2022 1 commit
- Whitespace formatting · 4f8b99f6
  Jon Tow authored Mar 19, 2022
  
  4f8b99f6
18 Mar, 2022 1 commit
- Refactor `Task` download · 7c9da714
  Jonathan Tow authored Mar 11, 2022
  
  7c9da714
28 Feb, 2022 2 commits
- Make citations module-level constants · 3f13d15f
  Jonathan Tow authored Feb 28, 2022
  
  3f13d15f
- Add citations and descriptions to all tasks · a1aceacd
  Jonathan Tow authored Feb 28, 2022
  
  a1aceacd
05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
08 Jan, 2022 1 commit
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
27 Mar, 2021 1 commit
- Remove unused imports and format imports · d5d19219
  Jonathan Tow authored Mar 26, 2021
  
  d5d19219
12 Feb, 2021 1 commit
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
11 Feb, 2021 2 commits
- Fixes to make greedy_until work · 432bd44c
  Leo Gao authored Feb 10, 2021
```
# Conflicts:
#	lm_eval/models/gpt2.py
#	lm_eval/tasks/squad.py
```
  432bd44c
- Fixes to make greedy_until work · 7b649ded
  Leo Gao authored Feb 10, 2021
  
  7b649ded
10 Feb, 2021 1 commit
- Fix arithmetic · 42df113c
  Leo Gao authored Feb 09, 2021
  
  42df113c
09 Feb, 2021 1 commit
- More task changes · 9b14235d
  Leo Gao authored Feb 08, 2021
  
  9b14235d
05 Feb, 2021 1 commit
- Update arithmetic.py · a55a5c52
  Leo Gao authored Feb 04, 2021
  
  a55a5c52
03 Feb, 2021 1 commit
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
28 Jan, 2021 1 commit
- Implement unit testing and fix lots of problems with tasks · 60a6fd8c
  Leo Gao authored Jan 27, 2021
  
  60a6fd8c
27 Jan, 2021 1 commit
- use openai's gpt3 datafiles instead of generating equations · baadb2da
  Kevin Wang authored Jan 27, 2021
  
  baadb2da
23 Jan, 2021 2 commits
- prepending a space, because it significantly increases log-likelihood of the correct answer. · 183f4721
  Kevin Wang authored Jan 14, 2021
  
  183f4721
- first attempt at adding arithmetic evaluations · a58e5e4b
  Kevin Wang authored Jan 14, 2021
  
  a58e5e4b