Commits · 2387f39daf0ac28f190a911c6bdc1bb629a1cb09 · gaoqiong / lm-evaluation-harness

06 Sep, 2023 1 commit
- Update README.md · 00c4ffff
  Lintang Sutawika authored Sep 06, 2023
```
Crossed WMT off.
```
  00c4ffff
05 Sep, 2023 2 commits
- change words/bytes calc for wikitext · a7286607
  haileyschoelkopf authored Sep 05, 2023
  
  a7286607
- edit to fix cot filter · 7601d828
  lintangsutawika authored Sep 05, 2023
  
  7601d828
04 Sep, 2023 11 commits
- add codexglue · 8c39bfc7
  lintangsutawika authored Sep 04, 2023
  
  8c39bfc7
- fixed template · 4f5b72bc
  lintangsutawika authored Sep 04, 2023
  
  4f5b72bc
- update flan mmlu · 4a752867
  lintangsutawika authored Sep 04, 2023
  
  4a752867
- udpate · 03be40e2
  lintangsutawika authored Sep 04, 2023
  
  03be40e2
- updates · e795efcf
  lintangsutawika authored Sep 04, 2023
  
  e795efcf
- edit group name · c8b76a3d
  lintangsutawika authored Sep 04, 2023
  
  c8b76a3d
- add flan_zeroshot · 0d195e90
  lintangsutawika authored Sep 04, 2023
  
  0d195e90
- add flan_fewshot · 3531d9c1
  lintangsutawika authored Sep 04, 2023
  
  3531d9c1
- add flan_cot_zeroshot · c06b0d6e
  lintangsutawika authored Sep 04, 2023
  
  c06b0d6e
- add bbh flan_cot_fewshot · 13940f1e
  lintangsutawika authored Sep 04, 2023
  
  13940f1e
- update · 06d3406e
  lintangsutawika authored Sep 04, 2023
  
  06d3406e
03 Sep, 2023 1 commit
- add mmlu variants · f23ae748
  lintangsutawika authored Sep 03, 2023
  
  f23ae748
01 Sep, 2023 1 commit
- edit stop token · a81ef1a7
  lintangsutawika authored Sep 01, 2023
  
  a81ef1a7
31 Aug, 2023 1 commit
- update to generate bbh configs · c3764d2c
  lintangsutawika authored Aug 31, 2023
  
  c3764d2c
30 Aug, 2023 7 commits
- moved API inside function; API expects json · 788b6f94
  baberabb authored Aug 30, 2023
  
  788b6f94
- add bbh · 24754ee4
  lintangsutawika authored Aug 30, 2023
  
  24754ee4
- checked coqa on readme · 8287fe7c
  lintangsutawika authored Aug 30, 2023
  
  8287fe7c
- fix formatting · f555a583
  lintangsutawika authored Aug 30, 2023
  
  f555a583
- running process for drop · 79aa53b1
  lintangsutawika authored Aug 30, 2023
  
  79aa53b1
- add coqa · 64d4600c
  lintangsutawika authored Aug 30, 2023
  
  64d4600c
- add drop · f9558ce5
  lintangsutawika authored Aug 30, 2023
  
  f9558ce5
28 Aug, 2023 2 commits
- Update default.yaml · 8817b561
  Lintang Sutawika authored Aug 29, 2023
  
  8817b561
- format · dd5b526b
  lintangsutawika authored Aug 28, 2023
  
  dd5b526b
26 Aug, 2023 3 commits
- add yaml · 648dcef1
  lintangsutawika authored Aug 26, 2023
  
  648dcef1
- add asdiv task · 69a08222
  lintangsutawika authored Aug 26, 2023
  
  69a08222
- add to readme · 04f5697d
  lintangsutawika authored Aug 26, 2023
  
  04f5697d
25 Aug, 2023 8 commits
- Add suggestions from autotyping · fc69d84f
  Ethan Smith authored Aug 25, 2023
```
This adds a bunch of simple annotations suggested by https://github.com/JelleZijlstra/autotyping.
```
  fc69d84f
- add wsc273 · 20f0f313
  lintangsutawika authored Aug 25, 2023
  
  20f0f313
- removed unused line · b7082722
  lintangsutawika authored Aug 25, 2023
  
  b7082722
- add benchmark with t5x · 5aec6f26
  lintangsutawika authored Aug 25, 2023
  
  5aec6f26
- added info · 1d77a7b8
  lintangsutawika authored Aug 25, 2023
  
  1d77a7b8
- reformat · ec4bc493
  lintangsutawika authored Aug 25, 2023
  
  ec4bc493
- fixed group to int · a3eb6393
  lintangsutawika authored Aug 25, 2023
  
  a3eb6393
- reformat · caac0843
  lintangsutawika authored Aug 25, 2023
  
  caac0843
24 Aug, 2023 2 commits
- adding record processing · adbbfb44
  lintangsutawika authored Aug 24, 2023
  
  adbbfb44
- add wsc utils · faa2e43d
  lintangsutawika authored Aug 24, 2023
  
  faa2e43d
23 Aug, 2023 1 commit
- temp · 691b4ca9
  lintangsutawika authored Aug 23, 2023
  
  691b4ca9