Commits · dae7b868611b66cf262b0fd8eb39c018a8de8203 · gaoqiong / lm-evaluation-harness

"llama.cpp/models/ggml-vocab-gpt-2.gguf.out" did not exist on "7aa90c0ea35f88a5ef227b773e5a9fe3a0fd7eb2"

05 Feb, 2022 1 commit
- Added decontamination to remaining evals · dae7b868
  Quentin Gregory Anthony authored Feb 05, 2022
  
  dae7b868
30 Oct, 2021 1 commit
- Replace the `fewshot_description` API with a `description_dict` based interface · 8ac99269
  Jonathan Tow authored Oct 30, 2021
  
  8ac99269
05 Jun, 2021 1 commit
- Add task versioning · 105fa974
  Leo Gao authored Jun 04, 2021
  
  105fa974
27 Mar, 2021 1 commit
- Pass random state around to fewshot_examples and fewshot_context · 3b2d5f6c
  Leo Gao authored Mar 26, 2021
  
  3b2d5f6c
26 Mar, 2021 1 commit
- wsc273: change random · d42af30d
  Leo Gao authored Mar 25, 2021
  
  d42af30d
12 Feb, 2021 1 commit
- metrics file · 1fb90b91
  & authored Feb 12, 2021
  
  1fb90b91
10 Feb, 2021 5 commits
- Rename list of loglikelihoods for consistency · 155aeee9
  Jon Tow authored Feb 10, 2021
  
  155aeee9
- Fix context orderings to match label positioning · 43e274f8
  Jon Tow authored Feb 10, 2021
  
  43e274f8
- Update spacing · 8b038c2a
  Leo Gao authored Feb 09, 2021
  
  8b038c2a
- Remove incorrect context from `fewshot_context` · 3a90e246
  Jonathan Tow authored Feb 10, 2021
  
  3a90e246
- Fix few-shot contexts for `Winograd Schema Challenge`-based tasks · 74f3307b
  Jonathan Tow authored Feb 09, 2021
  
  74f3307b
03 Feb, 2021 1 commit
- Refactor `Dataset` naming and `HFTask` properties · a60ef6fa
  Jonathan Tow authored Feb 02, 2021
  
  a60ef6fa
02 Feb, 2021 1 commit
- Implement `WSC273` evaluation and data processing · c32a13e8
  Jonathan Tow authored Feb 02, 2021
  
  c32a13e8
28 Jan, 2021 1 commit
- Implement unit testing and fix lots of problems with tasks · 60a6fd8c
  Leo Gao authored Jan 27, 2021
  
  60a6fd8c
22 Jan, 2021 2 commits
- Remove rewrite reminder comment from everything except SuperGLUE · f4120e59
  Leo Gao authored Jan 21, 2021
  
  f4120e59
- Clean up code, remove some footguns · e31b4b31
  Leo Gao authored Jan 21, 2021
  
  e31b4b31
06 Jan, 2021 1 commit
- Add comments to remind that evaluation needs to be written for the new framework · 2d2dbf96
  Leo Gao authored Jan 05, 2021
  
  2d2dbf96
05 Jan, 2021 1 commit
- Add reminder to rewrite · 08dc67ea
  Leo Gao authored Jan 05, 2021
  
  08dc67ea
23 Oct, 2020 1 commit

Renamed WSC to make distinction between SuperGLUE Winograd Schemas... · 05bd05e9

Charles Foster authored Oct 23, 2020

Renamed WSC to make distinction between SuperGLUE Winograd Schemas (SGWinogradSchemaChallenge) and WSC273 (WinogradSchemaChallenge273) clearer. Also, added WSC273.

05bd05e9