Commits · 909f734665879c4eb67a30186a901a93d7026c57 · gaoqiong / lm-evaluation-harness

29 Jun, 2023 1 commit
- Remove "select_continuation_from_batch_left_padding" · 909f7346
  Hailey Schoelkopf authored Jun 29, 2023
  
  909f7346
26 Jun, 2023 3 commits
- Update evaluator.py · adef6323
  Hailey Schoelkopf authored Jun 26, 2023
  
  adef6323
- Merge branch 'misc-cleanup-refactor' of... · a6d501f0
  haileyschoelkopf authored Jun 26, 2023
```
Merge branch 'misc-cleanup-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into misc-cleanup-refactor
```
  a6d501f0
- update delimiter->fewshot_delimiter · 89a5a865
  haileyschoelkopf authored Jun 26, 2023
  
  89a5a865
23 Jun, 2023 3 commits
- merge big-refactor into fix branch · 4f29f7cc
  haileyschoelkopf authored Jun 23, 2023
  
  4f29f7cc
- add additional err handling for get_git_commit_hash · f832c776
  haileyschoelkopf authored Jun 23, 2023
  
  f832c776
- make fewshot_docs warning more explicit · 8d14b376
  haileyschoelkopf authored Jun 23, 2023
  
  8d14b376
22 Jun, 2023 33 commits
- Hotfix samplers.py · 9dea125b
  Hailey Schoelkopf authored Jun 22, 2023
  
  9dea125b
- Merge pull request #565 from fattorib/seq2seq-refactor · 1fa02395
  Lintang Sutawika authored Jun 22, 2023
```
[Refactor] Seq2Seq Models with Multi-Device Support
```
  1fa02395
- Merge pull request #5 from EleutherAI/seq2seq-support · d3cfdcf6
  Hailey Schoelkopf authored Jun 22, 2023
```
fix edge cases for seq2seq
```
  d3cfdcf6
- fix edge cases for seq2seq · 0500fb33
  haileyschoelkopf authored Jun 22, 2023
  
  0500fb33
- Merge branch 'big-refactor' into seq2seq-refactor · 89ad0186
  Lintang Sutawika authored Jun 22, 2023
  
  89ad0186
- added for seq2seq greedy_until test · 6122efac
  lintangsutawika authored Jun 22, 2023
  
  6122efac
- rename boolq task name for testing · 6d8cdef8
  lintangsutawika authored Jun 22, 2023
  
  6d8cdef8
- merged conflict resolved · 783ffd1e
  lintangsutawika authored Jun 22, 2023
  
  783ffd1e
- remove pure seq2seq LM class · 82a21c36
  haileyschoelkopf authored Jun 22, 2023
  
  82a21c36
- fix issues with encoder_attns, test lambada · 621214e1
  haileyschoelkopf authored Jun 22, 2023
  
  621214e1
- remove stray print in AnthropicLM, add TODO · 1c409035
  haileyschoelkopf authored Jun 21, 2023
  
  1c409035
- rename hf_merged.py · 360f7c3e
  haileyschoelkopf authored Jun 21, 2023
  
  360f7c3e
- discard ctx toks for causal greedy_until · 3a6adddb
  haileyschoelkopf authored Jun 21, 2023
  
  3a6adddb
- more pre-commit · b48f5205
  haileyschoelkopf authored Jun 20, 2023
  
  b48f5205
- add start of docstring to HFLM · 86b71954
  haileyschoelkopf authored Jun 20, 2023
  
  86b71954
- init tensors on-device where possible · 0e4f5361
  haileyschoelkopf authored Jun 20, 2023
  
  0e4f5361
- automatically unwrap model when needed · bc7f52e6
  haileyschoelkopf authored Jun 20, 2023
  
  bc7f52e6
- remove some old code, edge-case seq2seq case · 1bd6229c
  haileyschoelkopf authored Jun 20, 2023
  
  1bd6229c
- remove stale comment · 9f36ab18
  haileyschoelkopf authored Jun 20, 2023
  
  9f36ab18
- improve pad_and_concat · fb8abcec
  haileyschoelkopf authored Jun 20, 2023
  
  fb8abcec
- allow include_task_folder to use non-leaf dir YAML files · 6d36a9c9
  haileyschoelkopf authored Jun 20, 2023
  
  6d36a9c9
- add preliminary working HF-auto LM · a4e84b4b
  haileyschoelkopf authored Jun 20, 2023
  
  a4e84b4b
- make seq2seq take correct args format · 0b4f88dd
  haileyschoelkopf authored Jun 20, 2023
  
  0b4f88dd
- resolved conflict · 1a6b31a8
  lintangsutawika authored Jun 22, 2023
  
  1a6b31a8
- fix small TaskConfig bugs · 1d7d3de5
  haileyschoelkopf authored Jun 20, 2023
  
  1d7d3de5
- comment on padding method for encoder · fd33fb97
  Benjamin Fattori authored Jun 11, 2023
  
  fd33fb97
- multi-device support for loglikelihood_rolling · 26a9a445
  Benjamin Fattori authored Jun 11, 2023
  
  26a9a445
- loglikelihood_rolling for seq2seq · 3589abbb
  Benjamin Fattori authored Jun 11, 2023
  
  3589abbb
- batch support for loglikelihood tokens · 3789d340
  Benjamin Fattori authored Jun 09, 2023
  
  3789d340
- resolved merge conflict · 0a3b8069
  lintangsutawika authored Jun 22, 2023
  
  0a3b8069
- accelerator multidevice setup · 1de7e4a5
  Benjamin Fattori authored Jun 07, 2023
  
  1de7e4a5
- commit on clean branch · 2af4f9e0
  Benjamin Fattori authored Jun 07, 2023
  
  2af4f9e0
- Merge pull request #4 from EleutherAI/seq2seq-support · 53ff475b
  Hailey Schoelkopf authored Jun 21, 2023
```
Fully merge hf-causal and seq2seq impls.
```
  53ff475b