Commits · e1ae8a2f52a68a66aca4233ad22bcf970861edd2 · gaoqiong / lm-evaluation-harness

21 Nov, 2023 1 commit
- update multi-token stopsequence handling · f7873a49
  haileyschoelkopf authored Nov 21, 2023
  
  f7873a49
17 Nov, 2023 8 commits
- update bigbench datasets to mirror, rename groupnames · 487767ab
  haileyschoelkopf authored Nov 17, 2023
  
  487767ab
- fix error when using wildcard task names · 2444b364
  haileyschoelkopf authored Nov 17, 2023
  
  2444b364
- fix error when using wildcard task names · aa9e1062
  haileyschoelkopf authored Nov 17, 2023
  
  aa9e1062
- format · bf6cf1de
  lintangsutawika authored Nov 17, 2023
  
  bf6cf1de
- will check if group_name is None · 2314ff4f
  lintangsutawika authored Nov 17, 2023
  
  2314ff4f
- precommit · f40b7d0e
  lintangsutawika authored Nov 17, 2023
  
  f40b7d0e
- removed provide_description arg · 0d209e2e
  lintangsutawika authored Nov 17, 2023
  
  0d209e2e
- edits and format · 10cc0a56
  lintangsutawika authored Nov 17, 2023
  
  10cc0a56
16 Nov, 2023 1 commit
- remove provide_description flag · a745d589
  haileyschoelkopf authored Nov 16, 2023
  
  a745d589
15 Nov, 2023 1 commit
- update squad file · c9a3fd3f
  lintangsutawika authored Nov 15, 2023
  
  c9a3fd3f
14 Nov, 2023 2 commits
- removed unused variables · d9230aa8
  lintangsutawika authored Nov 14, 2023
  
  d9230aa8
- enables tasks of different group but same task_alis (for example, if... · 7760573f
  lintangsutawika authored Nov 14, 2023
```
enables tasks of different group but same task_alis (for example, if evaluating on different versions of MMLU
```
  7760573f
10 Nov, 2023 2 commits
- fixes · 69186ef2
  lintangsutawika authored Nov 10, 2023
  
  69186ef2
- added initialize_task and updated where eval_logger is imported from · 056c9d85
  lintangsutawika authored Nov 10, 2023
  
  056c9d85
09 Nov, 2023 6 commits
- updates to scrolls · 51753750
  lintangsutawika authored Nov 09, 2023
  
  51753750
- reformat · 097c9253
  lintangsutawika authored Nov 09, 2023
  
  097c9253
- reformat · 6c812bb5
  lintangsutawika authored Nov 09, 2023
  
  6c812bb5
- reformat · 9a64e642
  lintangsutawika authored Nov 09, 2023
  
  9a64e642
- add scrolls · 75137836
  lintangsutawika authored Nov 09, 2023
  
  75137836
- readded task descriptions · a3520619
  lintangsutawika authored Nov 09, 2023
  
  a3520619
08 Nov, 2023 3 commits
- removed yaml version of squad · d3f429ac
  lintangsutawika authored Nov 08, 2023
  
  d3f429ac
- removed yaml version of squad · 9817e7c2
  lintangsutawika authored Nov 08, 2023
  
  9817e7c2
- added comment line · 7b60ead4
  lintangsutawika authored Nov 08, 2023
  
  7b60ead4
07 Nov, 2023 2 commits
- moved squad.py and format changes · e1d5c849
  lintangsutawika authored Nov 07, 2023
  
  e1d5c849
- add squad from master · 8bf55a20
  lintangsutawika authored Nov 07, 2023
  
  8bf55a20
06 Nov, 2023 2 commits
- add space after - · 44124d95
  lintangsutawika authored Nov 06, 2023
  
  44124d95
- remove samples in the table · 1e1dbaf3
  lintangsutawika authored Nov 06, 2023
  
  1e1dbaf3
03 Nov, 2023 5 commits
- upstream GGUF/llama.cpp model to big-refactor · b2b6a90b
  haileyschoelkopf authored Nov 03, 2023
  
  b2b6a90b
- fix bug with args.verbose · 5f3b8bf6
  haileyschoelkopf authored Nov 03, 2023
  
  5f3b8bf6
- fix gsm8k regexes · 93d088c8
  haileyschoelkopf authored Nov 03, 2023
  
  93d088c8
- Update _generate_configs.py · 4d9b928e
  Hailey Schoelkopf authored Nov 03, 2023
  
  4d9b928e
- remove gold_alias from codebase · 37ac5f46
  haileyschoelkopf authored Nov 03, 2023
  
  37ac5f46
02 Nov, 2023 7 commits
- cleanup hf tqdm · ad8eee89
  haileyschoelkopf authored Nov 02, 2023
  
  ad8eee89
- precommit format · 73f3029c
  lintangsutawika authored Nov 02, 2023
  
  73f3029c
- eval_logger is not imported from logger.py anymore · f701ba7d
  lintangsutawika authored Nov 02, 2023
  
  f701ba7d
- changed the order of import to allow the verbosity to take effect on other parts of the repo · 7ec82485
  lintangsutawika authored Nov 02, 2023
  
  7ec82485
- very rough way of utilzing verbosity · ca8b00cc
  lintangsutawika authored Nov 02, 2023
  
  ca8b00cc
- Rename greedy_until_template_yaml to generate_until_template_yaml · 0d1fb8a5
  Lintang Sutawika authored Nov 02, 2023
  
  0d1fb8a5
- removed print · 6eac0056
  lintangsutawika authored Nov 02, 2023
  
  6eac0056