Commits · a4e84b4bb83faa611ce4a77474dec44582e6fc16 · gaoqiong / lm-evaluation-harness

22 Jun, 2023 11 commits
- add preliminary working HF-auto LM · a4e84b4b
  haileyschoelkopf authored Jun 20, 2023
  
  a4e84b4b
- make seq2seq take correct args format · 0b4f88dd
  haileyschoelkopf authored Jun 20, 2023
  
  0b4f88dd
- resolved conflict · 1a6b31a8
  lintangsutawika authored Jun 22, 2023
  
  1a6b31a8
- fix small TaskConfig bugs · 1d7d3de5
  haileyschoelkopf authored Jun 20, 2023
  
  1d7d3de5
- comment on padding method for encoder · fd33fb97
  Benjamin Fattori authored Jun 11, 2023
  
  fd33fb97
- multi-device support for loglikelihood_rolling · 26a9a445
  Benjamin Fattori authored Jun 11, 2023
  
  26a9a445
- loglikelihood_rolling for seq2seq · 3589abbb
  Benjamin Fattori authored Jun 11, 2023
  
  3589abbb
- batch support for loglikelihood tokens · 3789d340
  Benjamin Fattori authored Jun 09, 2023
  
  3789d340
- resolved merge conflict · 0a3b8069
  lintangsutawika authored Jun 22, 2023
  
  0a3b8069
- accelerator multidevice setup · 1de7e4a5
  Benjamin Fattori authored Jun 07, 2023
  
  1de7e4a5
- commit on clean branch · 2af4f9e0
  Benjamin Fattori authored Jun 07, 2023
  
  2af4f9e0
21 Jun, 2023 8 commits
- Merge pull request #599 from EleutherAI/fix-gold-aliases · 5c72066b
  Hailey Schoelkopf authored Jun 21, 2023
```
[Refactor] More MCQA fixes
```
  5c72066b
- remove reference to undef `self.delimiter` · abe05c5d
  Hailey Schoelkopf authored Jun 21, 2023
  
  abe05c5d
- swap target_delimiter and fewshot_delimiter · a575d9e5
  Hailey Schoelkopf authored Jun 21, 2023
  
  a575d9e5
- Merge branch 'big-refactor' into fix-gold-aliases · 3dcde17b
  Lintang Sutawika authored Jun 21, 2023
  
  3dcde17b
- Update task.py · b8cb513b
  Lintang Sutawika authored Jun 21, 2023
  
  b8cb513b
- Update samplers.py · ebbb6c00
  Lintang Sutawika authored Jun 21, 2023
  
  ebbb6c00
- Update samplers.py · b85545b0
  Lintang Sutawika authored Jun 21, 2023
```
Use `target_delimiter`
```
  b85545b0
- made two delimiter modes · 977817a0
  lintangsutawika authored Jun 21, 2023
  
  977817a0
20 Jun, 2023 4 commits
- reformat for pre-commit · 3c805576
  lintangsutawika authored Jun 20, 2023
  
  3c805576
- BaseLM to LM · 6b375468
  lintangsutawika authored Jun 20, 2023
  
  6b375468
- Merge pull request #606 from EleutherAI/model-guide-docs · 6a000adb
  Lintang Sutawika authored Jun 20, 2023
```
[Refactor] Model guide docs
```
  6a000adb
- pre-commit reformat · 24321ad8
  lintangsutawika authored Jun 20, 2023
  
  24321ad8
19 Jun, 2023 10 commits
- commit WIP model guide docs · 60e8803f
  haileyschoelkopf authored Jun 19, 2023
  
  60e8803f
- rename progress.md · 3821762e
  haileyschoelkopf authored Jun 19, 2023
  
  3821762e
- remove descrip dict from test_evaluator · 77289aed
  haileyschoelkopf authored Jun 19, 2023
  
  77289aed
- rename test_description.py · 05a7d1da
  haileyschoelkopf authored Jun 19, 2023
  
  05a7d1da
- add description to config, remove from cmdline args · 194a806d
  haileyschoelkopf authored Jun 19, 2023
  
  194a806d
- re-add dtype flag · dd2b2de9
  haileyschoelkopf authored Jun 19, 2023
  
  dd2b2de9
- add evaluate to reqs · 1fb16673
  haileyschoelkopf authored Jun 19, 2023
  
  1fb16673
- misc fixes · 3f0afe02
  haileyschoelkopf authored Jun 19, 2023
  
  3f0afe02
- Update checklist for OBQA · 41677741
  Hailey Schoelkopf authored Jun 19, 2023
  
  41677741
- Merge pull request #600 from farzanehnakhaee70/add-openbookqa-config · c1dbda94
  Hailey Schoelkopf authored Jun 19, 2023
```
add openbookqa config
```
  c1dbda94
18 Jun, 2023 1 commit
- add openbookqa config · aa0326e3
  FarzanehNakhaee authored Jun 18, 2023
  
  aa0326e3
16 Jun, 2023 6 commits
- update docs + rest of mcqa tasks · de21abbd
  haileyschoelkopf authored Jun 16, 2023
  
  de21abbd
- Merge pull request #598 from EleutherAI/patch-multiple-choice · ff4b2fac
  Hailey Schoelkopf authored Jun 16, 2023
```
fixes for multiple_choice
```
  ff4b2fac
- minor fix · b4dd86e3
  lintangsutawika authored Jun 16, 2023
  
  b4dd86e3
- Merge branch 'big-refactor' of github.com:EleutherAI/lm-evaluation-harness... · 0dc67e6a
  lintangsutawika authored Jun 16, 2023
```
Merge branch 'big-refactor' of github.com:EleutherAI/lm-evaluation-harness into patch-multiple-choice
```
  0dc67e6a
- Update setup.py · c87fc788
  Lintang Sutawika authored Jun 17, 2023
  
  c87fc788
- fixes for multiple_choice · 4e72f165
  lintangsutawika authored Jun 16, 2023
  
  4e72f165