Commits · e00d682f4daa4b36921069218681384c623616df · gaoqiong / lm-evaluation-harness

"vscode:/vscode.git/clone" did not exist on "0a53c06e20dadae7655e9703a26cf67233525dd8"

29 Apr, 2022 2 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 4 commits
- Updated T0 and GPT-J · 29bff88d
  Tian Yun authored Apr 28, 2022
  
  29bff88d
- Modified stopping criteria for T5 and GPT-2 · 5e59320b
  Tian Yun authored Apr 28, 2022
  
  5e59320b
- Fixed generation trunction for GPT-2 and T5 · 6c86eb47
  Tian Yun authored Apr 28, 2022
  
  6c86eb47
- Add `eot_token` property to gpt-j · 32d0658c
  jon-tow authored Apr 28, 2022
  
  32d0658c
27 Apr, 2022 4 commits
- Adding null prompt support in T5 · 7da753f2
  Tian Yun authored Apr 27, 2022
  
  7da753f2
- Modified T0, T5 to BaseLM · 3c390461
  Tian Yun authored Apr 27, 2022
  
  3c390461
- Fixing stopping criteria · ecde9d2e
  Tian Yun authored Apr 27, 2022
  
  ecde9d2e
- Added GPT-J · a3a9a7c2
  Tian Yun authored Apr 26, 2022
  
  a3a9a7c2
26 Apr, 2022 5 commits
- Added t0, t5, mt5 · 716c87d6
  Tian Yun authored Apr 26, 2022
  
  716c87d6
- Modified stopping criteria for gpt2 · 61b57292
  Tian Yun authored Apr 26, 2022
  
  61b57292
- Added stoppping criteria for generation · 96ea7ddc
  Tian Yun authored Apr 26, 2022
  
  96ea7ddc
- Rename task specific to · f39c27c2
  cjlovering authored Apr 26, 2022
  
  f39c27c2
- Update the token encode · c26f1d4c
  cjlovering authored Apr 25, 2022
  
  c26f1d4c
13 Feb, 2022 1 commit
- gpt3: print exceptions · f6fb7f6a
  Leo Gao authored Feb 12, 2022
  
  f6fb7f6a
12 Feb, 2022 1 commit
- Update dummy model classmethod args · d895bfe6
  Stephen Hogg authored Feb 12, 2022
  
  d895bfe6
30 Jan, 2022 1 commit
- Small fixes · 341663a9
  researcher2 authored Jan 31, 2022
  
  341663a9
26 Dec, 2021 1 commit
- Implement decontamination of evals against training set 13 grams. · 6597c347
  researcher2 authored Dec 25, 2021
  
  6597c347
05 Dec, 2021 1 commit
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
05 Nov, 2021 2 commits
- Switch gpt3 to BaseLM · 8ef7a515
  Leo Gao authored Nov 05, 2021
  
  8ef7a515
- Merge TokenizedLM and TorchLM into BaseLM · fea936e6
  Leo Gao authored Nov 05, 2021
  
  fea936e6
11 Oct, 2021 1 commit
- Refactor LM organization for more reuse · 7f24a08b
  Leo Gao authored Oct 11, 2021
  
  7f24a08b
06 Oct, 2021 1 commit
- Make gpt2 a little more tokenizer agnostic · e5066c69
  Leo Gao authored Oct 05, 2021
  
  e5066c69
29 Sep, 2021 2 commits
- add support for HF revision · b569f483
  Leo Gao authored Sep 29, 2021
  
  b569f483
- gpt2: fix bad multi gpu behavior and typecheck inputs · 7f7b717d
  Leo Gao authored Sep 28, 2021
  
  7f7b717d
10 Jun, 2021 1 commit
- Add gpt3 tests · c59cd334
  Leo Gao authored Jun 10, 2021
  
  c59cd334
22 May, 2021 1 commit

make create_from_arg_string fully general · 9d6d291f

Leo Gao authored May 21, 2021

for some reason putting it in LM and having it be inherited breaks
everything. should try to figure this out at some point.

9d6d291f

11 May, 2021 3 commits
- Update gpt2.py · ebe9e6b9
  sdtblck authored May 11, 2021
  
  ebe9e6b9
- gpt2: extract model call · e6decf02
  Leo Gao authored May 11, 2021
  
  e6decf02
- Overhaul command flags a bit · 5f42f976
  Leo Gao authored May 10, 2021
```
model_args should only be things that affect output of the model
therefore, stuff like batch size, device, etc shouldn't be in there
```
  5f42f976
06 May, 2021 1 commit
- Rename a ton of stuff · 45127aa7
  Leo Gao authored May 05, 2021
  
  45127aa7
05 May, 2021 3 commits
- Minor changes · f16c301e
  Leo Gao authored May 05, 2021
  
  f16c301e
- Refactor PerplexityTask · 1e7f884d
  Leo Gao authored May 05, 2021
  
  1e7f884d
- Begin refactoring perplexity code · b0cf0163
  Leo Gao authored May 04, 2021
  
  b0cf0163
03 May, 2021 2 commits
- gpt3 compatibility · fa80f7bd
  Jason Phang authored May 02, 2021
  
  fa80f7bd
- gpt2 perplexity · 9454c839
  Jason Phang authored May 02, 2021
  
  9454c839
15 Apr, 2021 1 commit
- Actually fix problems and make tests pass · 31c29e3b
  Leo Gao authored Apr 14, 2021
  
  31c29e3b