Commits · 337492adbf26ae65d16f9ad9b7efb3e0dd2d4116 · gaoqiong / lm-evaluation-harness

04 Oct, 2023 6 commits
- fix wildcards · 09d935ee
  haileyschoelkopf authored Oct 04, 2023
  
  09d935ee
- change back to original dataset path · 51a43a76
  haileyschoelkopf authored Oct 04, 2023
  
  51a43a76
- change back to original dataset path · 54498fcc
  haileyschoelkopf authored Oct 04, 2023
  
  54498fcc
- move to __main__.py · 3b5e554f
  haileyschoelkopf authored Oct 04, 2023
  
  3b5e554f
- moved main to lm_eval/ to fix import of main error · 6f92c20d
  lintangsutawika authored Oct 04, 2023
  
  6f92c20d
- modify default yamls · 7e6e3c20
  haileyschoelkopf authored Oct 04, 2023
  
  7e6e3c20
03 Oct, 2023 5 commits
- add bigbench push_to_hub script · 67c0f73a
  haileyschoelkopf authored Oct 03, 2023
  
  67c0f73a
- add bigbench push_to_hub script · fa608798
  haileyschoelkopf authored Oct 03, 2023
  
  fa608798
- push updated bigbench task yamls · 8806944e
  haileyschoelkopf authored Oct 03, 2023
  
  8806944e
- update generate_tasks.py and template yamls · 1a77b4d5
  haileyschoelkopf authored Oct 03, 2023
  
  1a77b4d5
- Bring task name to `pubmedqa` in line with master branch · 3a7f52d0
  Hailey Schoelkopf authored Oct 03, 2023
  
  3a7f52d0
02 Oct, 2023 2 commits
- Fix formatting · 06ce7a62
  Chris authored Oct 02, 2023
  
  06ce7a62
- Add PolEmo2 tasks · e634f83f
  Chris authored Oct 02, 2023
  
  e634f83f
29 Sep, 2023 2 commits
- Update preprocess_pubmedqa.py · 6658f510
  Tanishq Abraham authored Sep 29, 2023
  
  6658f510
- Update pubmedqa.yaml · 5c418e2e
  Tanishq Abraham authored Sep 29, 2023
  
  5c418e2e
26 Sep, 2023 5 commits
- Update _default_template_yaml · 3d2ee4d4
  Hailey Schoelkopf authored Sep 26, 2023
  
  3d2ee4d4
- remove comments · 6ae9e9e8
  lintangsutawika authored Sep 26, 2023
  
  6ae9e9e8
- update loading prompts · b2d16321
  lintangsutawika authored Sep 26, 2023
  
  b2d16321
- modify to conform to pre-commit · 30711873
  lintangsutawika authored Sep 26, 2023
  
  30711873
- moved files · 3f090027
  lintangsutawika authored Sep 26, 2023
  
  3f090027
25 Sep, 2023 2 commits
- remove templerature as do_sample is False · 694af7d6
  lintangsutawika authored Sep 25, 2023
  
  694af7d6
- add function to add both task and benchmark · 0dc556dc
  lintangsutawika authored Sep 25, 2023
  
  0dc556dc
22 Sep, 2023 9 commits
- Fix formatting · 8310e67e
  Chris authored Sep 22, 2023
  
  8310e67e
- Fix formatting · ad4ab52a
  Chris authored Sep 22, 2023
  
  ad4ab52a
- Use 'is' for boolean comparison · 34d1ac6b
  Chris authored Sep 22, 2023
  
  34d1ac6b
- Add transformation filters: lowercase, uppercase, map · 90b261e5
  Chris authored Sep 22, 2023
  
  90b261e5
- Cast gold to the same type as result · 5b26b3b0
  Chris authored Sep 22, 2023
  
  5b26b3b0
- Allow forced import of metrics from the HF Evaluate library · 94346b7e
  Chris authored Sep 22, 2023
  
  94346b7e
- trigger precommit · d98159b2
  haileyschoelkopf authored Sep 22, 2023
  
  d98159b2
- trigger precommit · e4aa240e
  haileyschoelkopf authored Sep 22, 2023
  
  e4aa240e
- hotfix bugs · 43c91b5c
  haileyschoelkopf authored Sep 22, 2023
  
  43c91b5c
21 Sep, 2023 7 commits
- Note [math] extra · c8f56b17
  Hailey Schoelkopf authored Sep 21, 2023
  
  c8f56b17
- update · c6403765
  lintangsutawika authored Sep 21, 2023
  
  c6403765
- update · ea8b5beb
  lintangsutawika authored Sep 21, 2023
  
  ea8b5beb
- update · f0d8b559
  lintangsutawika authored Sep 21, 2023
  
  f0d8b559
- add codexglue · 76227f0d
  lintangsutawika authored Sep 21, 2023
  
  76227f0d
- Create README.md · 7418eddd
  Lintang Sutawika authored Sep 21, 2023
  
  7418eddd
- Fix positional arguments in HF model generate · 877e9a61
  Chris authored Sep 21, 2023
  
  877e9a61
19 Sep, 2023 2 commits
- fixed task and benchmark adding process · f921fc19
  lintangsutawika authored Sep 19, 2023
  
  f921fc19
- Update mgsm_cot_native_zh.yaml · 4a967f26
  Lintang Sutawika authored Sep 19, 2023
  
  4a967f26