Commits · acda980f4a3256591e39aee2bc170939bf2e2f25 · gaoqiong / lm-evaluation-harness

16 Nov, 2023 1 commit
- remove provide_description flag · a745d589
  haileyschoelkopf authored Nov 16, 2023
  
  a745d589
09 Nov, 2023 6 commits
- updates to scrolls · 51753750
  lintangsutawika authored Nov 09, 2023
  
  51753750
- reformat · 097c9253
  lintangsutawika authored Nov 09, 2023
  
  097c9253
- reformat · 6c812bb5
  lintangsutawika authored Nov 09, 2023
  
  6c812bb5
- reformat · 9a64e642
  lintangsutawika authored Nov 09, 2023
  
  9a64e642
- add scrolls · 75137836
  lintangsutawika authored Nov 09, 2023
  
  75137836
- readded task descriptions · a3520619
  lintangsutawika authored Nov 09, 2023
  
  a3520619
08 Nov, 2023 3 commits
- removed yaml version of squad · d3f429ac
  lintangsutawika authored Nov 08, 2023
  
  d3f429ac
- removed yaml version of squad · 9817e7c2
  lintangsutawika authored Nov 08, 2023
  
  9817e7c2
- added comment line · 7b60ead4
  lintangsutawika authored Nov 08, 2023
  
  7b60ead4
07 Nov, 2023 2 commits
- moved squad.py and format changes · e1d5c849
  lintangsutawika authored Nov 07, 2023
  
  e1d5c849
- add squad from master · 8bf55a20
  lintangsutawika authored Nov 07, 2023
  
  8bf55a20
06 Nov, 2023 2 commits
- add space after - · 44124d95
  lintangsutawika authored Nov 06, 2023
  
  44124d95
- remove samples in the table · 1e1dbaf3
  lintangsutawika authored Nov 06, 2023
  
  1e1dbaf3
03 Nov, 2023 4 commits
- fix bug with args.verbose · 5f3b8bf6
  haileyschoelkopf authored Nov 03, 2023
  
  5f3b8bf6
- fix gsm8k regexes · 93d088c8
  haileyschoelkopf authored Nov 03, 2023
  
  93d088c8
- Update _generate_configs.py · 4d9b928e
  Hailey Schoelkopf authored Nov 03, 2023
  
  4d9b928e
- remove gold_alias from codebase · 37ac5f46
  haileyschoelkopf authored Nov 03, 2023
  
  37ac5f46
02 Nov, 2023 6 commits
- cleanup hf tqdm · ad8eee89
  haileyschoelkopf authored Nov 02, 2023
  
  ad8eee89
- Rename greedy_until_template_yaml to generate_until_template_yaml · 0d1fb8a5
  Lintang Sutawika authored Nov 02, 2023
  
  0d1fb8a5
- removed print · 6eac0056
  lintangsutawika authored Nov 02, 2023
  
  6eac0056
- added group and task alias · 6dfe848e
  lintangsutawika authored Nov 02, 2023
  
  6dfe848e
- fixed stderr calculation · d1e7a30a
  lintangsutawika authored Nov 02, 2023
  
  d1e7a30a
- fixing display name · 29ba8cb1
  lintangsutawika authored Nov 02, 2023
  
  29ba8cb1
01 Nov, 2023 8 commits
- remove `--huggingface_login` · 4ac7f064
  Hailey Schoelkopf authored Nov 01, 2023
  
  4ac7f064
- replace with no_train mmlu dataset · f5cf38a9
  haileyschoelkopf authored Nov 01, 2023
  
  f5cf38a9
- rename template for generate_until bb tasks · a922db88
  haileyschoelkopf authored Nov 01, 2023
  
  a922db88
- remove nonstandard logger from evaluator.py · 2fda31ca
  haileyschoelkopf authored Nov 01, 2023
  
  2fda31ca
- fix tqdm total for hf model · 55407cd6
  haileyschoelkopf authored Nov 01, 2023
  
  55407cd6
- new way to display tasks · 60dd33c8
  lintangsutawika authored Nov 01, 2023
  
  60dd33c8
- new way to display tasks · f5bdefe8
  lintangsutawika authored Nov 01, 2023
  
  f5bdefe8
- add task and group alias · dd7002d6
  lintangsutawika authored Nov 01, 2023
  
  dd7002d6
31 Oct, 2023 1 commit
- fix warning for delimiter having no whitespace · 888d3035
  haileyschoelkopf authored Oct 31, 2023
  
  888d3035
20 Oct, 2023 2 commits
- Force conversion to str if type exceeds expected · 305b5460
  Zhiwei Zhuang authored Oct 20, 2023
  
  305b5460
- change huggingface_login from str to bool for privacy · bff237e6
  Zhiwei Zhuang authored Oct 20, 2023
  
  bff237e6
19 Oct, 2023 5 commits
- fixes to pythia benchmark, boolqseq2seq · 1428ad57
  haileyschoelkopf authored Oct 19, 2023
  
  1428ad57
- fix bug when target_delimiter is empty string · d9b4ca7f
  haileyschoelkopf authored Oct 19, 2023
  
  d9b4ca7f
- don't call evaluate.load() every time · ff148cd8
  haileyschoelkopf authored Oct 19, 2023
  
  ff148cd8
- fixed registered metric · 8d4d1fa9
  lintangsutawika authored Oct 19, 2023
  
  8d4d1fa9
- changed warning message · 9fbe6eef
  lintangsutawika authored Oct 19, 2023
  
  9fbe6eef