Commits · f6fb7f6a7e85be93d82c25c67666625e57ccc0bb · gaoqiong / lm-evaluation-harness

13 Feb, 2022 5 commits
- gpt3: print exceptions · f6fb7f6a
  Leo Gao authored Feb 12, 2022
  
  f6fb7f6a
- Update README.md · edc9449f
  Leo Gao authored Feb 12, 2022
  
  edc9449f
- Merge pull request #288 from EleutherAI/leogao2-patch-1 · 2cc968ba
  Leo Gao authored Feb 12, 2022
```
Update README.md
```
  2cc968ba
- Update README.md · 71647775
  Leo Gao authored Feb 12, 2022
  
  71647775
- Merge pull request #263 from jon-tow/hendrycks_math_checksum_update · c5131e8a
  Leo Gao authored Feb 12, 2022
```
Bump Hendrycks `MATH` because of updated dataset
```
  c5131e8a
12 Feb, 2022 2 commits
- Merge pull request #286 from StephenHogg/255 · c74ca57c
  Leo Gao authored Feb 12, 2022
```
Fix BUG: TypeError: create_from_arg_string() takes 2 positional arguments but 3 were given
```
  c74ca57c
- Update dummy model classmethod args · d895bfe6
  Stephen Hogg authored Feb 12, 2022
  
  d895bfe6
08 Feb, 2022 2 commits
- pin best-download to 0.0.9 · e18ef6e1
  Leo Gao authored Feb 07, 2022
  
  e18ef6e1
- Revert "Update requirements.txt" · 7d37dd4a
  Leo Gao authored Feb 07, 2022
```
This reverts commit 05590e11.
```
  7d37dd4a
06 Feb, 2022 2 commits
- Bump Hendrycks `MATH` because of updated dataset · 49dc29bd
  Jonathan Tow authored Feb 06, 2022
  
  49dc29bd
- Update requirements.txt · 05590e11
  Stella Biderman authored Feb 06, 2022
  
  05590e11
30 Jan, 2022 1 commit
- Merge pull request #259 from jon-tow/headqa-ux · 26f0233f
  Leo Gao authored Jan 30, 2022
```
Update `headqa` deprecation warning to display on init only
```
  26f0233f
23 Jan, 2022 1 commit
- Update `headqa` deprecation warning to display on init only · 03c15e06
  Jonathan Tow authored Jan 23, 2022
  
  03c15e06
15 Jan, 2022 3 commits
- cb: add testdata · 1c52e917
  Leo Gao authored Jan 14, 2022
  
  1c52e917
- Merge pull request #254 from bigscience-workshop/thomas/fix_cb · c3d941b9
  Leo Gao authored Jan 14, 2022
```
Fix CB
```
  c3d941b9
- Merge pull request #256 from jon-tow/update-asdiv · 4849702e
  Leo Gao authored Jan 14, 2022
```
Conform `asidv` to the new description api
```
  4849702e
13 Jan, 2022 1 commit
- Conform `asidv` to the new description api · caff4f10
  Jonathan Tow authored Jan 13, 2022
  
  caff4f10
11 Jan, 2022 3 commits
- Merge pull request #252 from bigscience-workshop/thomas/fix_best_download_version_1 · be40299e
  Leo Gao authored Jan 11, 2022
```
Best download fix
```
  be40299e
- Bump version · b421f052
  thomasw21 authored Jan 11, 2022
  
  b421f052
- Fix CB · ea3fd79b
  thomasw21 authored Jan 11, 2022
  
  ea3fd79b
08 Jan, 2022 10 commits
- Missed asdiv · 2d9fc256
  thomasw21 authored Jan 09, 2022
  
  2d9fc256
- Merge pull request #250 from bigscience-workshop/thomas/fix_best_download_version · ed6931e7
  Leo Gao authored Jan 08, 2022
```
Best-download have backward compatibility issue
```
  ed6931e7
- Merge branch 'master' into thomas/fix_best_download_version · 78824d7f
  Thomas Wang authored Jan 08, 2022
  
  78824d7f
- Merge pull request #243 from bigscience-workshop/thomas/fix_multirc · cc238121
  Leo Gao authored Jan 08, 2022
```
Fix multirc
```
  cc238121
- Merge pull request #226 from jon-tow/evaluator-description-option · 170ae096
  Leo Gao authored Jan 08, 2022
```
Replace `fewshot_description` API with a `description_dict` based interface
```
  170ae096
- Update blimp fewshot_context · 02a4def2
  Leo Gao authored Jan 08, 2022
  
  02a4def2
- Actually it shouldn't be hard to fix it to be compatible with future version · c65412e5
  thomasw21 authored Jan 08, 2022
  
  c65412e5
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into... · 5792030c
  Leo Gao authored Jan 08, 2022
```
Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into evaluator-description-option
```
  5792030c
- Fix fewshot_context method handling · b2f6bce8
  Leo Gao authored Jan 08, 2022
  
  b2f6bce8
- Best-download have backward compatibility issue · 76dc6093
  thomasw21 authored Jan 08, 2022
  
  76dc6093
04 Jan, 2022 5 commits
- Merge branch 'evaluator-description-option' of... · c3bec45f
  Jonathan Tow authored Jan 04, 2022
```
Merge branch 'evaluator-description-option' of https://github.com/jon-tow/lm-evaluation-harness into evaluator-description-option
```
  c3bec45f
- Enforce `rnd` args with assertions · d2636b4e
  Jonathan Tow authored Jan 04, 2022
  
  d2636b4e
- Update description_guide.md · d09561fe
  Leo Gao authored Jan 03, 2022
  
  d09561fe
- Merge pull request #244 from rokosbasilisk/asdiv · 8728710c
  Leo Gao authored Jan 03, 2022
```
add asdiv task
```
  8728710c
- Merge pull request #242 from igor0/bits_per_byte · 70a9c476
  Leo Gao authored Jan 03, 2022
```
Fix bits_per_byte metric in PerplexityTask
```
  70a9c476
03 Jan, 2022 5 commits
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into asdiv · 8dbd24f6
  Leo Gao authored Jan 03, 2022
  
  8dbd24f6
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness into bits_per_byte · ff58b389
  Leo Gao authored Jan 03, 2022
  
  ff58b389
- Merge branch 'master' of github.com:EleutherAI/lm-evaluation-harness · a67c17e0
  Leo Gao authored Jan 03, 2022
```
# Conflicts:
#	lm_eval/tasks/pile.py
```
  a67c17e0
- Delete test_cache.db · 9d87d476
  Leo Gao authored Jan 03, 2022
  
  9d87d476
- Improve pile test efficiency · cb3babd3
  Leo Gao authored Jan 03, 2022
  
  cb3babd3