Commits · fc63c7afb85db9c66a5050cc0afee8cdee89dd83 · gaoqiong / lm-evaluation-harness

17 Jul, 2023 11 commits
- edge case for P-Tuning in causal LM · fc63c7af
  haileyschoelkopf authored Jul 17, 2023
  
  fc63c7af
- remove results folder for now · 3362727d
  haileyschoelkopf authored Jul 17, 2023
  
  3362727d
- Merge pull request #684 from baberabb/big-refactor_output · 3cd3921f
  Hailey Schoelkopf authored Jul 17, 2023
```
edited output_path and added help to args
```
  3cd3921f
- removed stale args. added assertion if log_samples true and no output_path · decb55cd
  baberabb authored Jul 17, 2023
  
  decb55cd
- edited output_path and added help to args · 74ba283d
  baberabb authored Jul 17, 2023
  
  74ba283d
- Merge pull request #682 from yeoedward/anli · 4dfa8aba
  Lintang Sutawika authored Jul 17, 2023
```
[Refactor] Migrate ANLI tasks to yaml
```
  4dfa8aba
- Update anli_r3.yaml · 97a172ae
  Lintang Sutawika authored Jul 17, 2023
  
  97a172ae
- Update anli_r2.yaml · cd7f642d
  Lintang Sutawika authored Jul 17, 2023
  
  cd7f642d
- Update anli_r1.yaml · a7c1a639
  Lintang Sutawika authored Jul 17, 2023
  
  a7c1a639
- [Refactor] Migrate anli tasks to yaml · b783c68e
  Eddy Yeo authored Jul 17, 2023
  
  b783c68e
- Merge pull request #680 from baberabb/big-refactor_fixup · 7aa13c47
  Hailey Schoelkopf authored Jul 17, 2023
```
[Refactor] minor edits
```
  7aa13c47
16 Jul, 2023 2 commits
- set fp32 if device=mps · 43407f36
  baberabb authored Jul 16, 2023
  
  43407f36
- set fp32 if device=mps · ce214979
  baberabb authored Jul 16, 2023
  
  ce214979
15 Jul, 2023 2 commits
- add mps · 2bb7ce3b
  baberabb authored Jul 15, 2023
  
  2bb7ce3b
- removed rnd from task.fewshot_context in write_out.py; add mps in huggingface.py · 73b2149f
  baberabb authored Jul 15, 2023
  
  73b2149f
14 Jul, 2023 22 commits
- Update main.py · 283cad70
  Hailey Schoelkopf authored Jul 14, 2023
  
  283cad70
- Merge pull request #671 from EleutherAI/revamp-process · 2c20cd1f
  Lintang Sutawika authored Jul 14, 2023
```
Revamp process
```
  2c20cd1f
- Merge branch 'big-refactor' into revamp-process · 0dadc92a
  Lintang Sutawika authored Jul 14, 2023
  
  0dadc92a
- Merge pull request #678 from EleutherAI/fix-generative-multitarget · bfa57719
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Patch to revamp-process
```
  bfa57719
- make sure boolq works · d70f7134
  haileyschoelkopf authored Jul 14, 2023
  
  d70f7134
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- fix error · 60acbde2
  lintangsutawika authored Jul 14, 2023
  
  60acbde2
- remove info · 1ca2c0ba
  lintangsutawika authored Jul 14, 2023
  
  1ca2c0ba
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- Merge pull request #676 from EleutherAI/new-flags · 6862fa7d
  Lintang Sutawika authored Jul 14, 2023
```
[Refactor] Miscellaneous fixes
```
  6862fa7d
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- fix typehints in Instance() · 7684bfa9
  haileyschoelkopf authored Jul 14, 2023
  
  7684bfa9
- don't log samples if not requested · 04c81e7d
  haileyschoelkopf authored Jul 14, 2023
  
  04c81e7d
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
- updates, corrections, and fixes to match big-refactor · ee633332
  lintangsutawika authored Jul 14, 2023
  
  ee633332
- doc_to_target and doc_to_text should also accept int · 94a49f70
  lintangsutawika authored Jul 14, 2023
  
  94a49f70
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- adjustments · 70e3ed25
  lintangsutawika authored Jul 14, 2023
  
  70e3ed25
- Merge branch 'big-refactor' of... · 457c4262
  lintangsutawika authored Jul 14, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into revamp-process
```
  457c4262
- fixes to boolq · f4efb8e5
  lintangsutawika authored Jul 14, 2023
  
  f4efb8e5
- fixes to bollq · ae41f67c
  lintangsutawika authored Jul 14, 2023
  
  ae41f67c
13 Jul, 2023 3 commits
- log all arguments per doc · 09a71562
  haileyschoelkopf authored Jul 13, 2023
  
  09a71562
- add fast tokenizer flag · 165f8493
  haileyschoelkopf authored Jul 13, 2023
  
  165f8493
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73