Commits · d1ce515a80ee007a82c8ea9e6d2882589d555fac · gaoqiong / lm-evaluation-harness

28 Aug, 2023 4 commits
- reformat · 32efba17
  lintangsutawika authored Aug 28, 2023
  
  32efba17
- reformat · f4b1eb0f
  lintangsutawika authored Aug 28, 2023
  
  f4b1eb0f
- added model written eval configs · d97e7155
  lintangsutawika authored Aug 28, 2023
  
  d97e7155
- added anthropics' evals · 10c377ea
  lintangsutawika authored Aug 28, 2023
  
  10c377ea
27 Aug, 2023 1 commit
- format · 3768b1c4
  lintangsutawika authored Aug 27, 2023
  
  3768b1c4
26 Aug, 2023 2 commits
- add yaml · 648dcef1
  lintangsutawika authored Aug 26, 2023
  
  648dcef1
- add asdiv task · 69a08222
  lintangsutawika authored Aug 26, 2023
  
  69a08222
23 Aug, 2023 4 commits
- minor fix · f5d0f8e6
  lintangsutawika authored Aug 23, 2023
  
  f5d0f8e6
- readded missing chunk · 4fe3409e
  lintangsutawika authored Aug 23, 2023
  
  4fe3409e
- fix condition where a benchmark and a regular task is called together · 2f0ef6ca
  lintangsutawika authored Aug 23, 2023
  
  2f0ef6ca
- fix for choices · 32294ff1
  lintangsutawika authored Aug 23, 2023
  
  32294ff1
22 Aug, 2023 2 commits
- fix bleu · e3c70cad
  lintangsutawika authored Aug 22, 2023
  
  e3c70cad
- result is just 1 · 26196917
  lintangsutawika authored Aug 22, 2023
  
  26196917
21 Aug, 2023 3 commits
- no need to iterate over results for greedy_until · 4bba7abb
  lintangsutawika authored Aug 21, 2023
  
  4bba7abb
- fix naming · a38a0450
  lintangsutawika authored Aug 21, 2023
  
  a38a0450
- add checks · b2aee121
  lintangsutawika authored Aug 21, 2023
  
  b2aee121
17 Aug, 2023 1 commit
- don't exit if RTP api key not set · 197940f7
  haileyschoelkopf authored Aug 17, 2023
  
  197940f7
16 Aug, 2023 7 commits
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
15 Aug, 2023 16 commits
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- edit xstorycloze · 523ba954
  lintangsutawika authored Aug 15, 2023
  
  523ba954
- update triviaqa · 5be5cfcf
  lintangsutawika authored Aug 15, 2023
  
  5be5cfcf
- udpate storycloze · 14ad1317
  lintangsutawika authored Aug 15, 2023
  
  14ad1317
- update glue · 95b2a7d2
  lintangsutawika authored Aug 15, 2023
  
  95b2a7d2
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- update · 0a694910
  lintangsutawika authored Aug 15, 2023
  
  0a694910
- Update seq2seq.yaml · 61c49449
  Lintang Sutawika authored Aug 01, 2023
  
  61c49449
- Update seq2seq.yaml · 64e50a49
  Lintang Sutawika authored Aug 01, 2023
  
  64e50a49
- go through choices and targets · 0458e152
  lintangsutawika authored Jul 24, 2023
  
  0458e152
- removed comment · ffb56822
  lintangsutawika authored Jul 24, 2023
  
  ffb56822
- added warning regarding use of whitespace for target_delimiter and target, add... · db97d7f8
  lintangsutawika authored Jul 24, 2023
```
added warning regarding use of whitespace for target_delimiter and target, add feature to allow to acquire target from doc_to_choice for greedy_until, switch order between multiple_target and non multiple_target being processed
```
  db97d7f8