Commits · e211219642ed441418b0fc21acddf679eea95aca · gaoqiong / lm-evaluation-harness

25 Mar, 2021 1 commit
- Update fewshot_examples · e2112196
  Leo Gao authored Mar 25, 2021
  
  e2112196
22 Mar, 2021 4 commits
- Include `auxiliary_train` and all `dev` sets in `training_docs` · e3769082
  Jonathan Tow authored Mar 22, 2021
  
  e3769082
- Split `dev` and `val` sets and cleanup prompt spacing · 364e54d4
  Jonathan Tow authored Mar 22, 2021
  
  364e54d4
- Restore proper prompt formatting · b2bab740
  Jonathan Tow authored Mar 22, 2021
  
  b2bab740
- Refactor and simple formatting · 806b022b
  Jonathan Tow authored Mar 21, 2021
  
  806b022b
21 Mar, 2021 4 commits
- minor · 13b97626
  Andy Zou authored Mar 21, 2021
  
  13b97626
- added training · 7989168d
  Andy Zou authored Mar 21, 2021
  
  7989168d
- adjusted naming · 8888a6be
  Andy Zou authored Mar 20, 2021
  
  8888a6be
- add hendrycksTest · a6b01474
  Andy Zou authored Mar 20, 2021
  
  a6b01474
08 Mar, 2021 1 commit
- Implement `LogiQA` data download and evaluation · a187cd44
  Jonathan Tow authored Mar 08, 2021
  
  a187cd44
07 Mar, 2021 2 commits
- Minor tweaks · f1ac6435
  Leo Gao authored Mar 07, 2021
  
  f1ac6435
- Address the `EthicsUtilitarianism` `TODO`s · ab4939d3
  Jonathan Tow authored Mar 07, 2021
  
  ab4939d3
06 Mar, 2021 1 commit
- Flag down a bunch of todos · 491283c5
  Leo Gao authored Mar 05, 2021
  
  491283c5
01 Mar, 2021 2 commits
- Cleanups · 90b56db5
  Muennighoff authored Mar 01, 2021
  
  90b56db5
- Mimic original Ethics Util procedure · 001c0a05
  Muennighoff authored Mar 01, 2021
  
  001c0a05
27 Feb, 2021 3 commits
- Fix splitting · d6f6ff1d
  Muennighoff authored Feb 27, 2021
  
  d6f6ff1d
- Reasonable & Unreasonable loglikelihood · 90f1709b
  Muennighoff authored Feb 27, 2021
  
  90f1709b
- Swap .index for .split · 5b06573e
  Muennighoff authored Feb 27, 2021
  
  5b06573e
26 Feb, 2021 2 commits
- Make some very minor changes to the prompt · 35323047
  Leo Gao authored Feb 26, 2021
  
  35323047
- Remove custom fewshot examples · 37d4f617
  Leo Gao authored Feb 26, 2021
  
  37d4f617
24 Feb, 2021 2 commits
- Implement all word scrambling and manipulation tasks · 41a94e13
  Jon Tow authored Feb 24, 2021
  
  41a94e13
- Implement `Anagrams` evaluations · a5e135b6
  Jon Tow authored Feb 23, 2021
  
  a5e135b6
23 Feb, 2021 1 commit
- Fix translation context · ba9c13b2
  Leo Gao authored Feb 22, 2021
  
  ba9c13b2
21 Feb, 2021 6 commits
- Add acknowledgement to official implementation · 805b541c
  Jon Tow authored Feb 21, 2021
  
  805b541c
- Remove print statements · 5894761a
  Jon Tow authored Feb 21, 2021
  
  5894761a
- Undo formatting · 41a8b582
  Jon Tow authored Feb 21, 2021
  
  41a8b582
- Clean up · e4d852a0
  Jon Tow authored Feb 21, 2021
  
  e4d852a0
- Fixes · f4f7618a
  Jon Tow authored Feb 21, 2021
  
  f4f7618a
- Implement `DROP` evaluation · fc7cd630
  Jon Tow authored Feb 20, 2021
  
  fc7cd630
18 Feb, 2021 2 commits
- Adapt prompts to Ethics paper · 86c4115d
  Muennighoff authored Feb 18, 2021
  
  86c4115d
- Add Exact Match Metric · a7564ff3
  Muennighoff authored Feb 18, 2021
  
  a7564ff3
16 Feb, 2021 4 commits
- Correct Scoring · e3bdca80
  Muennighoff authored Feb 16, 2021
  
  e3bdca80
- Correct Path · 7c73f3c8
  Muennighoff authored Feb 16, 2021
  
  7c73f3c8
- Add Ethics Tasks · 400f812c
  Muennighoff authored Feb 16, 2021
  
  400f812c
- Add Virtue · d4606d27
  Muennighoff authored Feb 16, 2021
  
  d4606d27
15 Feb, 2021 4 commits
- Add Utilitarianism & Justice · b5c2952a
  Muennighoff authored Feb 15, 2021
  
  b5c2952a
- Label fixes · c9aad57f
  Muennighoff authored Feb 15, 2021
  
  c9aad57f
- Syntax · f123ce39
  Muennighoff authored Feb 15, 2021
  
  f123ce39
- Add Ethics CM & Deontology · 5c92d629
  Muennighoff authored Feb 15, 2021
  
  5c92d629
14 Feb, 2021 1 commit
- Fix CoQA for tests · 431e53de
  Leo Gao authored Feb 14, 2021
  
  431e53de