Commits · b06e797ab29e8e9656c2ab154771438282fcc840 · gaoqiong / lm-evaluation-harness

16 Jun, 2023 6 commits
- Merge branch 'big-refactor' into big-refactor-merge · b06e797a
  Lintang Sutawika authored Jun 16, 2023
  
  b06e797a
- Merge pull request #563 from farzanehnakhaee70/big-refactor · 3fc5bedc
  Lintang Sutawika authored Jun 16, 2023
```
Logging Samples
```
  3fc5bedc
- Merge commit 'refs/pull/563/head' of github.com:EleutherAI/lm-evaluation-harness into logging · 5b6847be
  lintangsutawika authored Jun 16, 2023
  
  5b6847be
- merged conflict · 4cc57af4
  lintangsutawika authored Jun 16, 2023
  
  4cc57af4
- Update .gitignore · 87fcaf89
  Lintang Sutawika authored Jun 16, 2023
  
  87fcaf89
- Merge branch 'big-refactor' into big-refactor-merge · b59fe379
  gk authored Jun 16, 2023
  
  b59fe379
15 Jun, 2023 21 commits
- Delete task_table.md · 5fa87056
  Hailey Schoelkopf authored Jun 15, 2023
  
  5fa87056
- Delete triviaqa.py · c7572ba6
  Hailey Schoelkopf authored Jun 15, 2023
  
  c7572ba6
- Delete gsm8k.py · 025fa6e8
  Hailey Schoelkopf authored Jun 15, 2023
  
  025fa6e8
- Update __init__.py · 2db1e7cb
  Hailey Schoelkopf authored Jun 15, 2023
  
  2db1e7cb
- Update README.md · 1347b197
  Hailey Schoelkopf authored Jun 15, 2023
  
  1347b197
- Update README.md · de021767
  Hailey Schoelkopf authored Jun 15, 2023
  
  de021767
- Delete task_guide.md · f191542a
  Stella Biderman authored Jun 15, 2023
  
  f191542a
- Update README.md · 8fb11989
  Stella Biderman authored Jun 15, 2023
  
  8fb11989
- Update README.md · 275f8609
  Stella Biderman authored Jun 15, 2023
  
  275f8609
- Update README.md · 81d33055
  Stella Biderman authored Jun 15, 2023
  
  81d33055
- Merge branch 'EleutherAI:big-refactor' into big-refactor · 9d3247be
  farzanehnakhaee70 authored Jun 15, 2023
  
  9d3247be
- Update README.md · f637b876
  Hailey Schoelkopf authored Jun 15, 2023
  
  f637b876
- Merge branch 'big-refactor' of github.com:EleutherAI/lm-evaluation-harness into big-refactor-merge · c490f165
  gk authored Jun 15, 2023
  
  c490f165
- Update task.py · 8c9fc6b6
  Lintang Sutawika authored Jun 15, 2023
  
  8c9fc6b6
- Merge branch 'big-refactor' into big-refactor · 8a42e342
  Lintang Sutawika authored Jun 15, 2023
  
  8a42e342
- Merge branch 'master' into big-refactor-merge · b5efc813
  gk authored Jun 15, 2023
  
  b5efc813
- Merge pull request #578 from EleutherAI/more-docs · b6c70fc8
  Lintang Sutawika authored Jun 15, 2023
```
[Refactor] Addressing Feedback on new docs pages
```
  b6c70fc8
- Merge branch 'big-refactor' into more-docs · 6be66284
  Lintang Sutawika authored Jun 15, 2023
  
  6be66284
- minor fixes to satisify pre-commit · 400c0199
  lintangsutawika authored Jun 15, 2023
  
  400c0199
- Merge branch 'big-refactor' of github.com:EleutherAI/lm-evaluation-harness into big-refactor-merge · 7dec84a0
  gk authored Jun 15, 2023
  
  7dec84a0
- Merge branch 'master' into big-refactor-test · e495e3a0
  gk authored Jun 14, 2023
  
  e495e3a0
14 Jun, 2023 11 commits
- Merge pull request #525 from seopbo/fix-triviaqa · b018a7d5
  Hailey Schoelkopf authored Jun 14, 2023
```
Fix triviaqa task
```
  b018a7d5
- Update triviaqa.py · 50cf0984
  Hailey Schoelkopf authored Jun 14, 2023
  
  50cf0984
- Merge pull request #579 from SONG-WONHO/master · 137d0c43
  Hailey Schoelkopf authored Jun 14, 2023
```
Add - 4bit-related args
```
  137d0c43
- Merge pull request #580 from EleutherAI/fix-tasks · 0c53ff49
  Lintang Sutawika authored Jun 14, 2023
```
fixes some minor issues on tasks. 
```
  0c53ff49
- Update __init__.py · ced29179
  Lintang Sutawika authored Jun 14, 2023
  
  ced29179
- rm triviaqa to use HF filtered dev set · 859e5920
  Hailey Schoelkopf authored Jun 14, 2023
  
  859e5920
- Change triviaqa dataset path · a1160392
  Hailey Schoelkopf authored Jun 14, 2023
  
  a1160392
- Change accuracy to acc · 346be595
  FarzanehNakhaee authored Jun 14, 2023
  
  346be595
- Update until in greedy_until · e33ae5ab
  FarzanehNakhaee authored Jun 14, 2023
  
  e33ae5ab
- Remove **self._metric_kwargs[key] from compute as it wasn't existed · c08b2d9d
  FarzanehNakhaee authored Jun 14, 2023
  
  c08b2d9d
- Fixed typo on num_fewshot · 6d355b85
  Lintang Sutawika authored Jun 14, 2023
  
  6d355b85
13 Jun, 2023 2 commits
- Merge branch 'big-refactor' into more-docs · 2ee7121b
  Hailey Schoelkopf authored Jun 13, 2023
  
  2ee7121b
- Merge pull request #585 from EleutherAI/fix-quantized-device · 9d06c953
  Hailey Schoelkopf authored Jun 13, 2023
```
Add error handling for calling `.to(device)`
```
  9d06c953