Commits · 1a02d9dfaaf29155842b7b80b100d007bb5b177d · gaoqiong / lm-evaluation-harness

05 Sep, 2023 2 commits
- pre-commit · 9bca36a9
  lintangsutawika authored Sep 05, 2023
  
  9bca36a9
- change words/bytes calc for wikitext · a7286607
  haileyschoelkopf authored Sep 05, 2023
  
  a7286607
04 Sep, 2023 1 commit
- placate precommit · f96f330f
  Hailey Schoelkopf authored Sep 04, 2023
  
  f96f330f
30 Aug, 2023 10 commits
- moved API inside function; API expects json · 788b6f94
  baberabb authored Aug 30, 2023
  
  788b6f94
- Update task.py · ebfff08f
  Lintang Sutawika authored Aug 30, 2023
  
  ebfff08f
- Update task.py · 8d1d003d
  Lintang Sutawika authored Aug 30, 2023
  
  8d1d003d
- checked coqa on readme · 8287fe7c
  lintangsutawika authored Aug 30, 2023
  
  8287fe7c
- fix formatting · f555a583
  lintangsutawika authored Aug 30, 2023
  
  f555a583
- running process for drop · 79aa53b1
  lintangsutawika authored Aug 30, 2023
  
  79aa53b1
- add coqa · 64d4600c
  lintangsutawika authored Aug 30, 2023
  
  64d4600c
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
- reformat · cddbf9f6
  lintangsutawika authored Aug 30, 2023
  
  cddbf9f6
- added checks for if gold is outside choice options · 65e5bc69
  lintangsutawika authored Aug 30, 2023
  
  65e5bc69
28 Aug, 2023 7 commits
- Delete dataset_infos.json · 25a667f5
  Lintang Sutawika authored Aug 29, 2023
  
  25a667f5
- Delete asdiv.py · 1b3330f3
  Lintang Sutawika authored Aug 29, 2023
  
  1b3330f3
- Delete __init__.py · 79b6434b
  Lintang Sutawika authored Aug 29, 2023
  
  79b6434b
- Delete __init__.py · ddfcb1fd
  Lintang Sutawika authored Aug 29, 2023
  
  ddfcb1fd
- Delete README.md · 94011b10
  Lintang Sutawika authored Aug 29, 2023
  
  94011b10
- Update default.yaml · 8817b561
  Lintang Sutawika authored Aug 29, 2023
  
  8817b561
- format · dd5b526b
  lintangsutawika authored Aug 28, 2023
  
  dd5b526b
27 Aug, 2023 1 commit
- format · 3768b1c4
  lintangsutawika authored Aug 27, 2023
  
  3768b1c4
26 Aug, 2023 5 commits
- add yaml · 648dcef1
  lintangsutawika authored Aug 26, 2023
  
  648dcef1
- add asdiv task · 69a08222
  lintangsutawika authored Aug 26, 2023
  
  69a08222
- fix FSDP error with .prepare_model() · 92561822
  Benjamin Fattori authored Aug 26, 2023
  
  92561822
- add to readme · 04f5697d
  lintangsutawika authored Aug 26, 2023
  
  04f5697d
- Fix lint failure · a551c789
  Ethan Smith authored Aug 25, 2023
  
  a551c789
25 Aug, 2023 8 commits
- Add suggestions from autotyping · fc69d84f
  Ethan Smith authored Aug 25, 2023
```
This adds a bunch of simple annotations suggested by https://github.com/JelleZijlstra/autotyping.
```
  fc69d84f
- add wsc273 · 20f0f313
  lintangsutawika authored Aug 25, 2023
  
  20f0f313
- removed unused line · b7082722
  lintangsutawika authored Aug 25, 2023
  
  b7082722
- add benchmark with t5x · 5aec6f26
  lintangsutawika authored Aug 25, 2023
  
  5aec6f26
- added info · 1d77a7b8
  lintangsutawika authored Aug 25, 2023
  
  1d77a7b8
- reformat · ec4bc493
  lintangsutawika authored Aug 25, 2023
  
  ec4bc493
- fixed group to int · a3eb6393
  lintangsutawika authored Aug 25, 2023
  
  a3eb6393
- reformat · caac0843
  lintangsutawika authored Aug 25, 2023
  
  caac0843
24 Aug, 2023 5 commits
- adding record processing · adbbfb44
  lintangsutawika authored Aug 24, 2023
  
  adbbfb44
- edit to accept docs · 599205c4
  lintangsutawika authored Aug 24, 2023
  
  599205c4
- add wsc utils · faa2e43d
  lintangsutawika authored Aug 24, 2023
  
  faa2e43d
- modified apply method to accept docs · 007d485b
  lintangsutawika authored Aug 24, 2023
  
  007d485b
- filter takes docs as argument in case filtering requires it · cb485883
  lintangsutawika authored Aug 24, 2023
  
  cb485883
23 Aug, 2023 1 commit
- minor fix · f5d0f8e6
  lintangsutawika authored Aug 23, 2023
  
  f5d0f8e6