Commits · 2a9da9fb3588ca6ed6aeea4aceca6d43623e9f94 · gaoqiong / lm-evaluation-harness

24 Apr, 2023 3 commits
- add metric + agg registries · 2a9da9fb
  haileyschoelkopf authored Apr 24, 2023
  
  2a9da9fb
- add template_vars + make jinja rendering stricter · 460584ca
  haileyschoelkopf authored Apr 23, 2023
  
  460584ca
- make tasks and models registered by decorators · f275301a
  haileyschoelkopf authored Apr 23, 2023
  
  f275301a
19 Apr, 2023 1 commit
- in-place replace main with lm-eval2, keeping old git history · d2a9b759
  haileyschoelkopf authored Apr 19, 2023
  
  d2a9b759
13 Apr, 2023 1 commit
- feat: peft model evals · 2b9a6e94
  Zach Nussbaum authored Apr 13, 2023
  
  2b9a6e94
07 Mar, 2023 1 commit
- enable "low_cpu_mem_usage" · 859f96fd
  Xingjian Shi authored Mar 07, 2023
  
  859f96fd
04 Feb, 2023 1 commit
- hotfix(gpt2): Remove vocab-size logits slice · 1a545447
  jon-tow authored Feb 04, 2023
  
  1a545447
17 Jan, 2023 1 commit
- first step: add HF+accelerate implementations · db1f55ff
  haileyschoelkopf authored Jan 17, 2023
  
  db1f55ff
04 Nov, 2022 1 commit
- Add `TextSynth` API (#299) · 4f0410a4
  Jonathan Tow authored Nov 03, 2022
```
* Add `TextSynth` API
```
  4f0410a4
15 Sep, 2022 3 commits
- Remove stale tokenizer comment · 3dc27bd2
  jon-tow authored Sep 15, 2022
  
  3dc27bd2
- Move `TODO`s into one source location · 5b1beceb
  jon-tow authored Sep 15, 2022
  
  5b1beceb
- Manually concat tokenizer revision with subfolder · ff83e9b2
  jon-tow authored Sep 15, 2022
  
  ff83e9b2
03 May, 2022 2 commits
- fix codespell · d95a4333
  Fabrizio Milo authored May 02, 2022
  
  d95a4333
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 2 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 4 commits
- Updated T0 and GPT-J · 29bff88d
  Tian Yun authored Apr 28, 2022
  
  29bff88d
- Modified stopping criteria for T5 and GPT-2 · 5e59320b
  Tian Yun authored Apr 28, 2022
  
  5e59320b
- Fixed generation trunction for GPT-2 and T5 · 6c86eb47
  Tian Yun authored Apr 28, 2022
  
  6c86eb47
- Add `eot_token` property to gpt-j · 32d0658c
  jon-tow authored Apr 28, 2022
  
  32d0658c
27 Apr, 2022 4 commits
- Adding null prompt support in T5 · 7da753f2
  Tian Yun authored Apr 27, 2022
  
  7da753f2
- Modified T0, T5 to BaseLM · 3c390461
  Tian Yun authored Apr 27, 2022
  
  3c390461
- Fixing stopping criteria · ecde9d2e
  Tian Yun authored Apr 27, 2022
  
  ecde9d2e
- Added GPT-J · a3a9a7c2
  Tian Yun authored Apr 26, 2022
  
  a3a9a7c2
26 Apr, 2022 5 commits
- Added t0, t5, mt5 · 716c87d6
  Tian Yun authored Apr 26, 2022
  
  716c87d6
- Modified stopping criteria for gpt2 · 61b57292
  Tian Yun authored Apr 26, 2022
  
  61b57292
- Added stoppping criteria for generation · 96ea7ddc
  Tian Yun authored Apr 26, 2022
  
  96ea7ddc
- Rename task specific to · f39c27c2
  cjlovering authored Apr 26, 2022
  
  f39c27c2
- Update the token encode · c26f1d4c
  cjlovering authored Apr 25, 2022
  
  c26f1d4c
13 Feb, 2022 1 commit
- gpt3: print exceptions · f6fb7f6a
  Leo Gao authored Feb 12, 2022
  
  f6fb7f6a
12 Feb, 2022 1 commit
- Update dummy model classmethod args · d895bfe6
  Stephen Hogg authored Feb 12, 2022
  
  d895bfe6
30 Jan, 2022 1 commit
- Small fixes · 341663a9
  researcher2 authored Jan 31, 2022
  
  341663a9
26 Dec, 2021 1 commit
- Implement decontamination of evals against training set 13 grams. · 6597c347
  researcher2 authored Dec 25, 2021
  
  6597c347
05 Dec, 2021 1 commit
- Get rid of get_token_logprobs · 7c011370
  Leo Gao authored Dec 05, 2021
  
  7c011370
24 Nov, 2021 2 commits
- update GPT3 test data and more docs · 53f6bc34
  Jason Phang authored Nov 23, 2021
  
  53f6bc34
- Some refactor/clean-up, and GPT-3 update · 76ebb792
  Jason Phang authored Nov 23, 2021
  
  76ebb792
05 Nov, 2021 2 commits
- Switch gpt3 to BaseLM · 8ef7a515
  Leo Gao authored Nov 05, 2021
  
  8ef7a515
- Merge TokenizedLM and TorchLM into BaseLM · fea936e6
  Leo Gao authored Nov 05, 2021
  
  fea936e6
11 Oct, 2021 1 commit
- Refactor LM organization for more reuse · 7f24a08b
  Leo Gao authored Oct 11, 2021
  
  7f24a08b
06 Oct, 2021 1 commit
- Make gpt2 a little more tokenizer agnostic · e5066c69
  Leo Gao authored Oct 05, 2021
  
  e5066c69