Commits · 9b1e0f595b13bf46dd210bef2bc11d838e80415f · gaoqiong / lm-evaluation-harness

"include/vscode:/vscode.git/clone" did not exist on "13a9d276250bd2d3c9fdd9ccf926d45fe820660b"

22 Aug, 2023 2 commits
- Revert "[Refactor] Fix metrics in Greedy Until" · 9b1e0f59
  Lintang Sutawika authored Aug 22, 2023
  
  9b1e0f59
- result is just 1 · 26196917
  lintangsutawika authored Aug 22, 2023
  
  26196917
21 Aug, 2023 2 commits
- no need to iterate over results for greedy_until · 4bba7abb
  lintangsutawika authored Aug 21, 2023
  
  4bba7abb
- add checks · b2aee121
  lintangsutawika authored Aug 21, 2023
  
  b2aee121
16 Aug, 2023 2 commits
- reformat · d6030e12
  lintangsutawika authored Aug 16, 2023
  
  d6030e12
- fix doc_to_target processing · db37024b
  lintangsutawika authored Aug 16, 2023
  
  db37024b
15 Aug, 2023 5 commits
- update · 0a694910
  lintangsutawika authored Aug 15, 2023
  
  0a694910
- go through choices and targets · 0458e152
  lintangsutawika authored Jul 24, 2023
  
  0458e152
- removed comment · ffb56822
  lintangsutawika authored Jul 24, 2023
  
  ffb56822
- added warning regarding use of whitespace for target_delimiter and target, add... · db97d7f8
  lintangsutawika authored Jul 24, 2023
```
added warning regarding use of whitespace for target_delimiter and target, add feature to allow to acquire target from doc_to_choice for greedy_until, switch order between multiple_target and non multiple_target being processed
```
  db97d7f8
- made fixes · 4b87456d
  lintangsutawika authored Aug 15, 2023
  
  4b87456d
14 Aug, 2023 9 commits
- Removed Implementation from metrics.py · 60763408
  Aflah authored Aug 03, 2023
  
  60763408
- Improved DocString · 57bcb4d6
  Aflah authored Aug 02, 2023
  
  57bcb4d6
- CMD Line Works · b221531a
  Aflah authored Aug 02, 2023
  
  b221531a
- Added Metric and Seems to Run but some Errors · d857e539
  Aflah authored Aug 02, 2023
  
  d857e539
- Base Template · 94ccc429
  Aflah authored Aug 02, 2023
  
  94ccc429
- return fewshot_delimiter if we get "" · 7758d16a
  lintangsutawika authored Aug 14, 2023
  
  7758d16a
- add warning log if prompt returns empty string · 1701c4e2
  lintangsutawika authored Aug 14, 2023
  
  1701c4e2
- add warning log if prompt returns empty string · 722b8974
  lintangsutawika authored Aug 14, 2023
  
  722b8974
- add warning log if prompt returns empty string · bc951ac1
  lintangsutawika authored Aug 14, 2023
  
  bc951ac1
09 Aug, 2023 3 commits
- add sampler condition for if target is multiple, and target_delimiter is " " · 1d3599a3
  lintangsutawika authored Aug 09, 2023
  
  1d3599a3
- removed line · 898cdd8b
  lintangsutawika authored Aug 09, 2023
  
  898cdd8b
- allow doc_to_target to be list so that multiple_target works · c2990e29
  lintangsutawika authored Aug 09, 2023
  
  c2990e29
08 Aug, 2023 2 commits
- ensure multiple_choice task type respects target_delimiter · cf1370d1
  haileyschoelkopf authored Aug 08, 2023
  
  cf1370d1
- added typehints · 97f5c020
  baberabb authored Aug 08, 2023
  
  97f5c020
07 Aug, 2023 1 commit
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
03 Aug, 2023 1 commit
- Removed Implementation from metrics.py · 7b376ae1
  Aflah authored Aug 03, 2023
  
  7b376ae1
02 Aug, 2023 5 commits
- Improved DocString · c42cb562
  Aflah authored Aug 02, 2023
  
  c42cb562
- CMD Line Works · eaa1c766
  Aflah authored Aug 02, 2023
  
  eaa1c766
- Added Metric and Seems to Run but some Errors · 62b8a6ce
  Aflah authored Aug 02, 2023
  
  62b8a6ce
- Base Template · 6cb8169c
  Aflah authored Aug 02, 2023
  
  6cb8169c
- Update task.py · 53105bba
  Lintang Sutawika authored Aug 02, 2023
  
  53105bba
01 Aug, 2023 3 commits
- update on metrics and delet files · e37698df
  lintangsutawika authored Aug 01, 2023
  
  e37698df
- skips metrics prep if process_result is not None · 1813bf04
  lintangsutawika authored Aug 01, 2023
  
  1813bf04
- process int label to string for greedy_until · b2598de8
  lintangsutawika authored Aug 01, 2023
  
  b2598de8
24 Jul, 2023 1 commit
- Use num_fewshot set in yaml and show warning if it's being overwritten by argparse · 8add5ed6
  lintangsutawika authored Jul 24, 2023
  
  8add5ed6
21 Jul, 2023 2 commits
- [Refactor] Migrate xwinograd tasks to yaml · 94563a36
  Eddy Yeo authored Jul 21, 2023
  
  94563a36
- make process_docs boolean more clear · 3d7f777d
  haileyschoelkopf authored Jul 21, 2023
  
  3d7f777d
18 Jul, 2023 2 commits
- [Refactor] Migrate webqs task to yaml · d2332149
  Eddy Yeo authored Jul 18, 2023
  
  d2332149
- remove template_aliases fully from taskconfig · fbc26541
  haileyschoelkopf authored Jul 18, 2023
  
  fbc26541