Commits · c21240c0a9b68f5845e8705aeb5326b17da2d3bb · gaoqiong / lm-evaluation-harness

17 Nov, 2023 1 commit
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
15 Nov, 2023 1 commit
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f
10 Nov, 2023 1 commit
- added initialize_task and updated where eval_logger is imported from · 056c9d85
  lintangsutawika authored Nov 10, 2023
  
  056c9d85
09 Nov, 2023 4 commits
- updates to scrolls · 51753750
  lintangsutawika authored Nov 09, 2023
  
  51753750
- reformat · 097c9253
  lintangsutawika authored Nov 09, 2023
  
  097c9253
- reformat · 6c812bb5
  lintangsutawika authored Nov 09, 2023
  
  6c812bb5
- reformat · 9a64e642
  lintangsutawika authored Nov 09, 2023
  
  9a64e642
08 Nov, 2023 2 commits
- removed yaml version of squad · d3f429ac
  lintangsutawika authored Nov 08, 2023
  
  d3f429ac
- added comment line · 7b60ead4
  lintangsutawika authored Nov 08, 2023
  
  7b60ead4
07 Nov, 2023 2 commits
- moved squad.py and format changes · e1d5c849
  lintangsutawika authored Nov 07, 2023
  
  e1d5c849
- add squad from master · 8bf55a20
  lintangsutawika authored Nov 07, 2023
  
  8bf55a20
02 Nov, 2023 3 commits
- precommit format · 73f3029c
  lintangsutawika authored Nov 02, 2023
  
  73f3029c
- eval_logger is not imported from logger.py anymore · f701ba7d
  lintangsutawika authored Nov 02, 2023
  
  f701ba7d
- very rough way of utilzing verbosity · ca8b00cc
  lintangsutawika authored Nov 02, 2023
  
  ca8b00cc
19 Oct, 2023 2 commits
- fix issue with default metrics and aggregation functions · 90d818da
  lintangsutawika authored Oct 19, 2023
  
  90d818da
- fix two bugs when ran with qasper_bool and toxigen · a007bacb
  Zhiwei Zhuang authored Oct 19, 2023
  
  a007bacb
17 Oct, 2023 1 commit
- change all mentions of `greedy_until` to `generate_until` · c64bf9a9
  lintangsutawika authored Oct 17, 2023
  
  c64bf9a9
12 Oct, 2023 1 commit
- Update __init__.py · 32a6362c
  Lintang Sutawika authored Oct 12, 2023
  
  32a6362c
10 Oct, 2023 3 commits
- error set to DEBUG · e33a7d92
  lintangsutawika authored Oct 10, 2023
  
  e33a7d92
- add verbose arg · 9894597c
  lintangsutawika authored Oct 10, 2023
  
  9894597c
- removed delimiter="" · bc1b0eca
  lintangsutawika authored Oct 10, 2023
  
  bc1b0eca
08 Oct, 2023 1 commit
- Improve error logging · 4d8094bb
  baberabb authored Oct 09, 2023
  
  4d8094bb
05 Oct, 2023 1 commit
- removed print messages, added cot extraction strings · 20a54b3a
  lintangsutawika authored Oct 05, 2023
  
  20a54b3a
26 Sep, 2023 3 commits
- remove comments · 6ae9e9e8
  lintangsutawika authored Sep 26, 2023
  
  6ae9e9e8
- update loading prompts · b2d16321
  lintangsutawika authored Sep 26, 2023
  
  b2d16321
- moved files · 3f090027
  lintangsutawika authored Sep 26, 2023
  
  3f090027
25 Sep, 2023 1 commit
- add function to add both task and benchmark · 0dc556dc
  lintangsutawika authored Sep 25, 2023
  
  0dc556dc
19 Sep, 2023 4 commits
- fixed task and benchmark adding process · f921fc19
  lintangsutawika authored Sep 19, 2023
  
  f921fc19
- format · a2009452
  lintangsutawika authored Sep 19, 2023
  
  a2009452
- moved benchmarks back to tasks/ · 1ed76cfa
  lintangsutawika authored Sep 19, 2023
  
  1ed76cfa
- Update __init__.py · 8daee342
  Lintang Sutawika authored Sep 19, 2023
  
  8daee342
18 Sep, 2023 1 commit
- changes to promptsource output_type reverted · c6dc1ca4
  Hojjat Mokhtarabadi authored Sep 18, 2023
  
  c6dc1ca4
14 Sep, 2023 1 commit
- Use Dict to make the code python 3.8 compatible · 38c9689a
  Chris authored Sep 14, 2023
  
  38c9689a
12 Sep, 2023 1 commit
- allow nested groups · f7d98500
  lintangsutawika authored Sep 12, 2023
  
  f7d98500
10 Sep, 2023 1 commit
- undefined type and output_type when using promptsource fixed · 7a462453
  Hojjat Mokhtarabadi authored Sep 10, 2023
  
  7a462453
25 Aug, 2023 1 commit

Add suggestions from autotyping · fc69d84f

Ethan Smith authored Aug 25, 2023

This adds a bunch of simple annotations suggested by https://github.com/JelleZijlstra/autotyping.

fc69d84f

14 Aug, 2023 1 commit
- adjustments to have `task` to modify a task name in benchmark · 3de2c0e7
  lintangsutawika authored Aug 14, 2023
  
  3de2c0e7
13 Aug, 2023 3 commits
- formate · ce8c2b14
  lintangsutawika authored Aug 13, 2023
  
  ce8c2b14
- update and fixes · 5ddabc29
  lintangsutawika authored Aug 13, 2023
  
  5ddabc29
- moved to a new dir · f4813cfc
  lintangsutawika authored Aug 13, 2023
  
  f4813cfc