Commits · 35323047d0d820bb77c15c53e06f2b6ccc31fe80 · gaoqiong / lm-evaluation-harness

"awq_ext/attention/cuda_bf16_fallbacks.cuh" did not exist on "e90433a0e0b96e0fbd94b356016bcaed88d2b41d"

26 Feb, 2021 1 commit
- Make some very minor changes to the prompt · 35323047
  Leo Gao authored Feb 26, 2021
  
  35323047
18 Feb, 2021 2 commits
- Adapt prompts to Ethics paper · 86c4115d
  Muennighoff authored Feb 18, 2021
  
  86c4115d
- Add Exact Match Metric · a7564ff3
  Muennighoff authored Feb 18, 2021
  
  a7564ff3
16 Feb, 2021 4 commits
- Correct Scoring · e3bdca80
  Muennighoff authored Feb 16, 2021
  
  e3bdca80
- Correct Path · 7c73f3c8
  Muennighoff authored Feb 16, 2021
  
  7c73f3c8
- Add Ethics Tasks · 400f812c
  Muennighoff authored Feb 16, 2021
  
  400f812c
- Add Virtue · d4606d27
  Muennighoff authored Feb 16, 2021
  
  d4606d27
15 Feb, 2021 4 commits
- Add Utilitarianism & Justice · b5c2952a
  Muennighoff authored Feb 15, 2021
  
  b5c2952a
- Label fixes · c9aad57f
  Muennighoff authored Feb 15, 2021
  
  c9aad57f
- Syntax · f123ce39
  Muennighoff authored Feb 15, 2021
  
  f123ce39
- Add Ethics CM & Deontology · 5c92d629
  Muennighoff authored Feb 15, 2021
  
  5c92d629
14 Feb, 2021 5 commits
- Fix CoQA for tests · 431e53de
  Leo Gao authored Feb 14, 2021
  
  431e53de
- move task list to init file · b1619834
  & authored Feb 14, 2021
  
  b1619834
- look at available pairs languages · b5bb7f6c
  & authored Feb 14, 2021
  
  b5bb7f6c
- ReCoRD fixup · 2cfdd80a
  Jason Phang authored Feb 13, 2021
  
  2cfdd80a
- tweak doc format · 2719a522
  Jason Phang authored Feb 13, 2021
  
  2719a522
13 Feb, 2021 6 commits
- Call greedy_until continuation, download fix · 68122ef4
  thefazzer authored Feb 13, 2021
  
  68122ef4
- ReCoRD fix · e4e9228e
  Jason Phang authored Feb 13, 2021
  
  e4e9228e
- Refactor `HeadQA` as a `MultipleChoiceTask` · 97174266
  Jonathan Tow authored Feb 13, 2021
  
  97174266
- Update lambada data location · e5a9de80
  Leo Gao authored Feb 12, 2021
  
  e5a9de80
- small change to regex · b07ecab4
  Anthony DiPofi authored Feb 12, 2021
  
  b07ecab4
- change mathqa to use numeric answer strings instead of a,b,c,d,e as choices · 81e42932
  Anthony DiPofi authored Feb 12, 2021
  
  81e42932
12 Feb, 2021 9 commits
- ... · e56381f4
  & authored Feb 12, 2021
  
  e56381f4
- adds missing task error · 1eb91d36
  & authored Feb 12, 2021
  
  1eb91d36
- Fixed metrics. Translation works · 61aa411b
  & authored Feb 12, 2021
  
  61aa411b
- add tasks to registry · 1297e342
  & authored Feb 12, 2021
  
  1297e342
- refactor MathQA as MultipleChoiceTask, uses full words for Q. and A. · c6c67272
  Anthony DiPofi authored Feb 12, 2021
  
  c6c67272
- translation task draft 1. Not hooked up, no metrics · bd3fcce0
  & authored Feb 12, 2021
  
  bd3fcce0
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
- Refactor `ARC` as a `MultipleChoiceTask` · 24ac76df
  Jon Tow authored Feb 11, 2021
  
  24ac76df
- add headqa and mathqa datasets · 742b5df2
  Anthony DiPofi authored Feb 11, 2021
  
  742b5df2
11 Feb, 2021 2 commits
- Fixes to make greedy_until work · 432bd44c
  Leo Gao authored Feb 10, 2021
```
# Conflicts:
#	lm_eval/models/gpt2.py
#	lm_eval/tasks/squad.py
```
  432bd44c
- Remove test set from `HellaSwag` · a2b108b9
  Jon Tow authored Feb 10, 2021
  
  a2b108b9
10 Feb, 2021 7 commits
- Refactor `HellaSwag` as a `MultipleChoiceTask` · 43ffe351
  Jon Tow authored Feb 10, 2021
  
  43ffe351
- Rename list of loglikelihoods for consistency · 155aeee9
  Jon Tow authored Feb 10, 2021
  
  155aeee9
- Fix context orderings to match label positioning · 43e274f8
  Jon Tow authored Feb 10, 2021
  
  43e274f8
- Update spacing · 8b038c2a
  Leo Gao authored Feb 09, 2021
  
  8b038c2a
- Remove incorrect context from `fewshot_context` · 3a90e246
  Jonathan Tow authored Feb 10, 2021
  
  3a90e246
- Update qa4mre.py · 5960874b
  Leo Gao authored Feb 09, 2021
  
  5960874b
- Add missing space in MultiRC · e9e5d0a2
  Leo Gao authored Feb 09, 2021
  
  e9e5d0a2