Commits · 80fe11d8d3bfdd21d85dfb84a63113a8072e4475 · gaoqiong / lm-evaluation-harness

20 May, 2023 1 commit
- unwrap model to get pos embs · 65127577
  Benjamin Fattori authored May 20, 2023
  
  65127577
10 May, 2023 3 commits
- balance documents among hosts for wikitext · 8f859cd2
  Benjamin Fattori authored May 10, 2023
  
  8f859cd2
- drop comments about pytorch DP · 3cfd23a1
  Benjamin Fattori authored May 10, 2023
  
  3cfd23a1
- fix warning issue if single device · 4d3ea67a
  Benjamin Fattori authored May 10, 2023
  
  4d3ea67a
08 May, 2023 3 commits
- add mutual info, code cleanup · 95642aa6
  haileyschoelkopf authored May 08, 2023
  
  95642aa6
- warning if launched incorrectly on multiGPU machine · 46f37ec0
  Benjamin Fattori authored May 08, 2023
  
  46f37ec0
- clean up cumul batches for rolling + remove unused print · c4447dab
  Benjamin Fattori authored May 08, 2023
  
  c4447dab
06 May, 2023 3 commits
- partial support for document-level padding · 32d7593d
  Benjamin Fattori authored May 06, 2023
  
  32d7593d
- assert + help message if script called incorrectly with multigpu · a8d9a449
  Benjamin Fattori authored May 06, 2023
  
  a8d9a449
- record _rank/_world_size for single GPU · a7d6cb2d
  Benjamin Fattori authored May 06, 2023
  
  a7d6cb2d
05 May, 2023 3 commits
- add utility func for slicing iterators, only tqdm on main process · eddd627a
  Benjamin Fattori authored May 05, 2023
  
  eddd627a
- bugfixes missed from local branch · 629bcfba
  Benjamin Fattori authored May 05, 2023
  
  629bcfba
- sync working changes with upstream · d4c5315a
  Benjamin Fattori authored May 05, 2023
  
  d4c5315a
02 May, 2023 1 commit
- prelim. multiple choice support · 487f7811
  haileyschoelkopf authored May 02, 2023
  
  487f7811
24 Apr, 2023 3 commits
- add metric + agg registries · 2a9da9fb
  haileyschoelkopf authored Apr 24, 2023
  
  2a9da9fb
- add template_vars + make jinja rendering stricter · 460584ca
  haileyschoelkopf authored Apr 23, 2023
  
  460584ca
- make tasks and models registered by decorators · f275301a
  haileyschoelkopf authored Apr 23, 2023
  
  f275301a
19 Apr, 2023 1 commit
- in-place replace main with lm-eval2, keeping old git history · d2a9b759
  haileyschoelkopf authored Apr 19, 2023
  
  d2a9b759
13 Apr, 2023 1 commit
- feat: peft model evals · 2b9a6e94
  Zach Nussbaum authored Apr 13, 2023
  
  2b9a6e94
07 Mar, 2023 1 commit
- enable "low_cpu_mem_usage" · 859f96fd
  Xingjian Shi authored Mar 07, 2023
  
  859f96fd
04 Feb, 2023 1 commit
- hotfix(gpt2): Remove vocab-size logits slice · 1a545447
  jon-tow authored Feb 04, 2023
  
  1a545447
17 Jan, 2023 1 commit
- first step: add HF+accelerate implementations · db1f55ff
  haileyschoelkopf authored Jan 17, 2023
  
  db1f55ff
04 Nov, 2022 1 commit
- Add `TextSynth` API (#299) · 4f0410a4
  Jonathan Tow authored Nov 03, 2022
```
* Add `TextSynth` API
```
  4f0410a4
15 Sep, 2022 3 commits
- Remove stale tokenizer comment · 3dc27bd2
  jon-tow authored Sep 15, 2022
  
  3dc27bd2
- Move `TODO`s into one source location · 5b1beceb
  jon-tow authored Sep 15, 2022
  
  5b1beceb
- Manually concat tokenizer revision with subfolder · ff83e9b2
  jon-tow authored Sep 15, 2022
  
  ff83e9b2
03 May, 2022 2 commits
- fix codespell · d95a4333
  Fabrizio Milo authored May 02, 2022
  
  d95a4333
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 2 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 4 commits
- Updated T0 and GPT-J · 29bff88d
  Tian Yun authored Apr 28, 2022
  
  29bff88d
- Modified stopping criteria for T5 and GPT-2 · 5e59320b
  Tian Yun authored Apr 28, 2022
  
  5e59320b
- Fixed generation trunction for GPT-2 and T5 · 6c86eb47
  Tian Yun authored Apr 28, 2022
  
  6c86eb47
- Add `eot_token` property to gpt-j · 32d0658c
  jon-tow authored Apr 28, 2022
  
  32d0658c
27 Apr, 2022 4 commits
- Adding null prompt support in T5 · 7da753f2
  Tian Yun authored Apr 27, 2022
  
  7da753f2
- Modified T0, T5 to BaseLM · 3c390461
  Tian Yun authored Apr 27, 2022
  
  3c390461
- Fixing stopping criteria · ecde9d2e
  Tian Yun authored Apr 27, 2022
  
  ecde9d2e
- Added GPT-J · a3a9a7c2
  Tian Yun authored Apr 26, 2022
  
  a3a9a7c2
26 Apr, 2022 2 commits
- Added t0, t5, mt5 · 716c87d6
  Tian Yun authored Apr 26, 2022
  
  716c87d6
- Modified stopping criteria for gpt2 · 61b57292
  Tian Yun authored Apr 26, 2022
  
  61b57292