Commits · 7d16a7cd8af33c63da1fd2e36f8a1957788e33a6 · gaoqiong / lm-evaluation-harness

23 Aug, 2023 6 commits
- minor fix · f5d0f8e6
  lintangsutawika authored Aug 23, 2023
  
  f5d0f8e6
- readded missing chunk · 4fe3409e
  lintangsutawika authored Aug 23, 2023
  
  4fe3409e
- fix condition where a benchmark and a regular task is called together · 2f0ef6ca
  lintangsutawika authored Aug 23, 2023
  
  2f0ef6ca
- temp · 691b4ca9
  lintangsutawika authored Aug 23, 2023
  
  691b4ca9
- fix for choices · 32294ff1
  lintangsutawika authored Aug 23, 2023
  
  32294ff1
- temp · 18f7dfb3
  lintangsutawika authored Aug 23, 2023
  
  18f7dfb3
22 Aug, 2023 7 commits
- add multirc metrics · 8c93320a
  lintangsutawika authored Aug 22, 2023
  
  8c93320a
- add cb metrics · 4a768feb
  lintangsutawika authored Aug 22, 2023
  
  4a768feb
- fix test_choice test · 80d88899
  lintangsutawika authored Aug 22, 2023
  
  80d88899
- update yaml · f7a0235d
  lintangsutawika authored Aug 22, 2023
  
  f7a0235d
- added truncation option · d4e075e3
  lintangsutawika authored Aug 22, 2023
  
  d4e075e3
- fix bleu · e3c70cad
  lintangsutawika authored Aug 22, 2023
  
  e3c70cad
- result is just 1 · 26196917
  lintangsutawika authored Aug 22, 2023
  
  26196917
21 Aug, 2023 3 commits
- no need to iterate over results for greedy_until · 4bba7abb
  lintangsutawika authored Aug 21, 2023
  
  4bba7abb
- fix naming · a38a0450
  lintangsutawika authored Aug 21, 2023
  
  a38a0450
- add checks · b2aee121
  lintangsutawika authored Aug 21, 2023
  
  b2aee121
17 Aug, 2023 1 commit
- don't exit if RTP api key not set · 197940f7
  haileyschoelkopf authored Aug 17, 2023
  
  197940f7
16 Aug, 2023 7 commits
- raise SystemExit 0 · 13f84b83
  lintangsutawika authored Aug 16, 2023
  
  13f84b83
- changed raise variable · 2fcd4298
  lintangsutawika authored Aug 16, 2023
  
  2fcd4298
- Update utils.py · 5b4f175f
  Lintang Sutawika authored Aug 16, 2023
  
  5b4f175f
- reformat · 579c9db9
  lintangsutawika authored Aug 16, 2023
  
  579c9db9
- change process to not require googleapi library · 60007dcf
  lintangsutawika authored Aug 16, 2023
  
  60007dcf
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
15 Aug, 2023 16 commits
- update readme docs · da8af971
  lintangsutawika authored Aug 15, 2023
  
  da8af971
- add mc taco · cfbc5a8a
  lintangsutawika authored Aug 15, 2023
  
  cfbc5a8a
- format · 135b41ce
  lintangsutawika authored Aug 15, 2023
  
  135b41ce
- edit readme · 0436b5d6
  lintangsutawika authored Aug 15, 2023
  
  0436b5d6
- add all truthfulqa tasks · b990b756
  lintangsutawika authored Aug 15, 2023
  
  b990b756
- edit xstorycloze · 523ba954
  lintangsutawika authored Aug 15, 2023
  
  523ba954
- update triviaqa · 5be5cfcf
  lintangsutawika authored Aug 15, 2023
  
  5be5cfcf
- udpate storycloze · 14ad1317
  lintangsutawika authored Aug 15, 2023
  
  14ad1317
- update glue · 95b2a7d2
  lintangsutawika authored Aug 15, 2023
  
  95b2a7d2
- Update README.md · 4b0ab122
  Lintang Sutawika authored Aug 15, 2023
  
  4b0ab122
- update · 0a694910
  lintangsutawika authored Aug 15, 2023
  
  0a694910
- Update seq2seq.yaml · 61c49449
  Lintang Sutawika authored Aug 01, 2023
  
  61c49449
- Update seq2seq.yaml · 64e50a49
  Lintang Sutawika authored Aug 01, 2023
  
  64e50a49
- go through choices and targets · 0458e152
  lintangsutawika authored Jul 24, 2023
  
  0458e152
- removed comment · ffb56822
  lintangsutawika authored Jul 24, 2023
  
  ffb56822
- added warning regarding use of whitespace for target_delimiter and target, add... · db97d7f8
  lintangsutawika authored Jul 24, 2023
```
added warning regarding use of whitespace for target_delimiter and target, add feature to allow to acquire target from doc_to_choice for greedy_until, switch order between multiple_target and non multiple_target being processed
```
  db97d7f8