Commits · a09cc41f0f2eea26b15cf61e0873d2fd1889dff6 · gaoqiong / lm-evaluation-harness

13 Jan, 2023 3 commits
- remove an unnecessary print · a09cc41f
  Albert Jiang authored Jan 13, 2023
  
  a09cc41f
- fix a bug with greedy eval · 32612dc6
  Albert Jiang authored Jan 13, 2023
  
  32612dc6
- allow task-specific descriptions to be passed to · 1576e99e
  Albert Jiang authored Jan 13, 2023
```
request construction
```
  1576e99e
06 Jan, 2023 1 commit
- implementing temperature sampling and maj@k for gpt2 · 99fdec0c
  Albert Jiang authored Jan 06, 2023
  
  99fdec0c
16 Dec, 2022 1 commit
- Update `lambada_openai` multilingual data source · 2bae14d2
  jon-tow authored Dec 16, 2022
  
  2bae14d2
13 Dec, 2022 1 commit
- Bump `triviaqa` version · f7aeeff2
  jon-tow authored Dec 12, 2022
  
  f7aeeff2
02 Dec, 2022 2 commits
- Remove redefinition of `jieba` · 1e5d55d9
  jon-tow authored Dec 02, 2022
  
  1e5d55d9
- Cleanup `README.md` and package deps · 0699d774
  jon-tow authored Dec 02, 2022
  
  0699d774
25 Nov, 2022 1 commit
- Add the original `LAMBADA` dataset · bfa57687
  jon-tow authored Nov 24, 2022
  
  bfa57687
24 Jun, 2022 1 commit
- fix key access in squad evaluation metrics · 1a153185
  Konstantin Schulz authored Jun 24, 2022
  
  1a153185
11 Jun, 2022 1 commit
- Remove custom datasets that are in HF · b4c0275d
  jon-tow authored Jun 11, 2022
  
  b4c0275d
03 May, 2022 3 commits
- Revert `tests/testdata` changes and address flake8 issues · 8c997e53
  jon-tow authored May 03, 2022
  
  8c997e53
- fix codespell · d95a4333
  Fabrizio Milo authored May 02, 2022
  
  d95a4333
- add pre-commit · 121b7096
  Fabrizio Milo authored May 02, 2022
  
  121b7096
29 Apr, 2022 5 commits
- Revert "Merge branch 'master' into master" · 7585ec56
  jon-tow authored Apr 29, 2022
```
This reverts commit 5fe7e2c0, reversing
changes made to 14b8ec7e.
```
  7585ec56
- integrate HuffPost to EvalHarness · 2c165797
  KhalidAlt authored Apr 29, 2022
  
  2c165797
- Update lama.py · 49f117ed
  KhalidAlt authored Apr 29, 2022
```
set (has_test_docs) to true
```
  49f117ed
- Update lama.py · 674e0564
  KhalidAlt authored Apr 29, 2022
  
  674e0564
- Fix max generation limit · eda365f6
  jon-tow authored Apr 28, 2022
  
  eda365f6
28 Apr, 2022 21 commits
- Update __init__.py · 13676905
  KhalidAlt authored Apr 28, 2022
  
  13676905
- Update __init__.py · 00903bc3
  KhalidAlt authored Apr 28, 2022
```
Add lama and bigscience lama
```
  00903bc3
- Rename all `_load_doc`s to `_process_doc` · bc9f6fc5
  jon-tow authored Apr 21, 2022
  
  bc9f6fc5
- Rename bigsciencelama.py to lama.py · 0816eba0
  KhalidAlt authored Apr 28, 2022
```
change file name
```
  0816eba0
- Added CrowsPairs for English and French · 2d861a29
  Oskar authored Apr 28, 2022
  
  2d861a29
- Update stopping criteria for few-shot · b62d1bec
  Tian Yun authored Apr 28, 2022
  
  b62d1bec
- comment unimplemented task · 235494f4
  KhalidAlt authored Apr 28, 2022
  
  235494f4
- add dataset description · 58abbac2
  KhalidAlt authored Apr 28, 2022
  
  58abbac2
- add lama task · 383318fe
  KhalidAlt authored Apr 28, 2022
  
  383318fe
- Add `axg` and `axb` to `super_glue` · 10492f4b
  jon-tow authored Apr 28, 2022
  
  10492f4b
- e2e_nlg_cleaned: Disable stopping criteria · 4be48911
  Zdenek Kasner authored Apr 28, 2022
  
  4be48911
- added task to init · e04aab6d
  Jan-Christoph Kalo authored Apr 28, 2022
  
  e04aab6d
- added bigscience-lama evaluation script. · 27a8f231
  Jan-Christoph Kalo authored Apr 28, 2022
  
  27a8f231
- e2e_nlg_cleaned: Update stopping criteria to "\n\n", exclude an accuracy-based prompt · 6588bc74
  Zdenek Kasner authored Apr 28, 2022
  
  6588bc74
- add docstring · ec80b255
  jordiclive authored Apr 28, 2022
  
  ec80b255
- GEM Simplification · 8cd91624
  jordiclive authored Apr 28, 2022
  
  8cd91624
- adding challenge sets · d42d5423
  jordiclive authored Apr 28, 2022
  
  d42d5423
- Remove custom max_length method · 9aba053a
  Zdenek Kasner authored Apr 28, 2022
  
  9aba053a
- WinoBias support added · 7010e452
  tomlimi authored Apr 28, 2022
  
  7010e452
- Fix `mlsum` task names after split update · 22ea032f
  jon-tow authored Apr 28, 2022
  
  22ea032f
- Fix functions · a80d78db
  Shashi456 authored Apr 28, 2022
  
  a80d78db