Commits · ec05e561dde62361896dd4677f643ae2c42ac0ae · gaoqiong / lm-evaluation-harness

25 Jan, 2024 3 commits
- reformat · be5472a9
  lintangsutawika authored Jan 25, 2024
  
  be5472a9
- fix group being loaded with a None · 7fe0ced5
  lintangsutawika authored Jan 25, 2024
  
  7fe0ced5
- revert back to use load_yaml_config but with modes · 60f52803
  lintangsutawika authored Jan 25, 2024
  
  60f52803
23 Jan, 2024 29 commits
- temporary scroll implementation · c5d27743
  lintangsutawika authored Jan 23, 2024
  
  c5d27743
- add squadv2 yaml · 64b99504
  lintangsutawika authored Jan 23, 2024
  
  64b99504
- remove print lines · 512412e0
  lintangsutawika authored Jan 23, 2024
  
  512412e0
- can load individual custom python class task · d352a549
  lintangsutawika authored Jan 23, 2024
  
  d352a549
- testing returning to python task list · 86ec5a53
  lintangsutawika authored Jan 23, 2024
  
  86ec5a53
- edit test yaml · b7075cb9
  lintangsutawika authored Jan 22, 2024
  
  b7075cb9
- check if config is task update · 318d706b
  lintangsutawika authored Jan 22, 2024
  
  318d706b
- group in a list of group can accept parameter changes like `num_fewshot` · 6584e6d6
  lintangsutawika authored Jan 22, 2024
  
  6584e6d6
- removed comments · db50055e
  lintangsutawika authored Jan 22, 2024
  
  db50055e
- fixed bug · e5e6b286
  lintangsutawika authored Jan 22, 2024
  
  e5e6b286
- remove unused import · 9c8670b7
  lintangsutawika authored Jan 22, 2024
  
  9c8670b7
- removed unused code · b9efb088
  lintangsutawika authored Jan 20, 2024
  
  b9efb088
- removed test lines · 9e98d1a9
  lintangsutawika authored Jan 20, 2024
  
  9e98d1a9
- further tidy up · 73c8c87c
  lintangsutawika authored Jan 20, 2024
  
  73c8c87c
- simplified code · 52e0148a
  lintangsutawika authored Jan 20, 2024
  
  52e0148a
- fixed typo · 6475a2b5
  lintangsutawika authored Jan 20, 2024
  
  6475a2b5
- fixed typo · 007e5b80
  lintangsutawika authored Jan 20, 2024
  
  007e5b80
- iron out bugs · 8db2ec3e
  lintangsutawika authored Jan 20, 2024
  
  8db2ec3e
- adapted initialize_tasks · 153ea28e
  lintangsutawika authored Jan 20, 2024
  
  153ea28e
- indexing and loading are part of a task_manager object · e487748e
  lintangsutawika authored Jan 20, 2024
  
  e487748e
- temp save · f9c51329
  lintangsutawika authored Jan 20, 2024
  
  f9c51329
- allow groups and tasks to work · 72859bbc
  lintangsutawika authored Jan 19, 2024
  
  72859bbc
- half working for nested groups · fea304e0
  lintangsutawika authored Jan 19, 2024
  
  fea304e0
- load_task_or_group works but only for tasks · 702593ec
  lintangsutawika authored Jan 19, 2024
  
  702593ec
- pre-commit format · 57f158b3
  lintangsutawika authored Jan 19, 2024
  
  57f158b3
- more comprehensive way to index tasks and groups · fe9f0d46
  lintangsutawika authored Jan 19, 2024
  
  fe9f0d46
- initialize_tasks returns list of tasks and groups · 55ea2888
  lintangsutawika authored Jan 19, 2024
  
  55ea2888
- task for testing recursive · d5071b70
  lintangsutawika authored Jan 19, 2024
  
  d5071b70
- Update migrated HF dataset paths (#1332) · 45a8f709
  Hailey Schoelkopf authored Jan 22, 2024
```
* Update arc_easy.yaml

* Update flan_cot.yaml

* update HF dataset path

* Update freeform.yaml

* Update flan_cot.yaml

---------
Co-authored-by: Lintang Sutawika <lintang@eleuther.ai>
```
  45a8f709
22 Jan, 2024 4 commits
- group in a list of group can accept parameter changes like `num_fewshot` · d4546ef8
  lintangsutawika authored Jan 22, 2024
  
  d4546ef8
- removed comments · a2c516bd
  lintangsutawika authored Jan 22, 2024
  
  a2c516bd
- fixed bug · 1b0858e7
  lintangsutawika authored Jan 22, 2024
  
  1b0858e7
- remove unused import · 8864e1a9
  lintangsutawika authored Jan 22, 2024
  
  8864e1a9
20 Jan, 2024 4 commits
- removed unused code · 12bc8fce
  lintangsutawika authored Jan 20, 2024
  
  12bc8fce
- removed test lines · b3b6aa03
  lintangsutawika authored Jan 20, 2024
  
  b3b6aa03
- further tidy up · d2a7dbf2
  lintangsutawika authored Jan 20, 2024
  
  d2a7dbf2
- simplified code · 5dfc887d
  lintangsutawika authored Jan 20, 2024
  
  5dfc887d