Commits · d1139741257c9ed5e484ec06cab66162074e41b9 · gaoqiong / lm-evaluation-harness

22 Nov, 2023 1 commit
- make `deepsparse` import conditional · d1139741
  Hailey Schoelkopf authored Nov 22, 2023
  
  d1139741
21 Nov, 2023 4 commits
- Update with latest and polish · 4747d318
  Michael Goin authored Nov 21, 2023
  
  4747d318
- Merge branch 'EleutherAI:master' into deepsparselm · da0b6f86
  Michael Goin authored Nov 21, 2023
  
  da0b6f86
- Merge pull request #1007 from EleutherAI/haileyschoelkopf-patch-2 · c1bd72c7
  Lintang Sutawika authored Nov 21, 2023
  
  c1bd72c7
- Update README.md · 8a191bfb
  Hailey Schoelkopf authored Nov 21, 2023
  
  8a191bfb
20 Nov, 2023 3 commits
- Merge pull request #1005 from Andrei-Aksionov/fix_indent_lm_eval_tasks_bigbench · 115206dc
  Stella Biderman authored Nov 20, 2023
```
Fix indent in lm_eval/tasks/bigbench.py
```
  115206dc
- Fix indent. · de4b07fd
  Andrei-Aksionov authored Nov 20, 2023
  
  de4b07fd
- Merge pull request #1004 from EleutherAI/py3.8 · 6843c5d7
  Lintang Sutawika authored Nov 20, 2023
```
Adds Python 3.8 Compatibility
```
  6843c5d7
19 Nov, 2023 2 commits
- Add Python 3.8 compatibility · c5fc2b19
  Stella Biderman authored Nov 18, 2023
  
  c5fc2b19
- Update setup.py · 674cf52e
  Stella Biderman authored Nov 18, 2023
  
  674cf52e
09 Nov, 2023 1 commit
- Override greedy_until · e9953abb
  mgoin authored Nov 09, 2023
  
  e9953abb
08 Nov, 2023 2 commits
- Update with Damian's implementation for logits · 2c8e66d7
  mgoin authored Nov 08, 2023
  
  2c8e66d7
- Merge branch 'EleutherAI:master' into deepsparselm · 8941c067
  Michael Goin authored Nov 08, 2023
  
  8941c067
03 Nov, 2023 8 commits
- Merge pull request #617 from matthoffner/master · 008fc2a2
  Hailey Schoelkopf authored Nov 03, 2023
```
Add GGML model
```
  008fc2a2
- Update gguf.py · 05c29914
  Hailey Schoelkopf authored Nov 03, 2023
  
  05c29914
- cleanup and fix variable names for GGUF model · 1fdc005e
  Hailey Schoelkopf authored Nov 03, 2023
  
  1fdc005e
- Update and rename test_ggml.py to test_gguf.py · 97bc9780
  Hailey Schoelkopf authored Nov 03, 2023
  
  97bc9780
- Update and rename ggml.py to gguf.py · 2d433a4a
  Hailey Schoelkopf authored Nov 03, 2023
  
  2d433a4a
- ggml -> gguf rename , __init__.py · 32f2bcf3
  Hailey Schoelkopf authored Nov 03, 2023
  
  32f2bcf3
- ggml -> gguf in readme · a2e95308
  Hailey Schoelkopf authored Nov 03, 2023
  
  a2e95308
- Merge pull request #948 from glerzing/licenses · 382af8c9
  Hailey Schoelkopf authored Nov 03, 2023
```
Dataset licenses - PR 2
```
  382af8c9
01 Nov, 2023 5 commits
- Merge pull request #792 from ClaireGyn/cmmlu · cc9778fb
  Stella Biderman authored Nov 01, 2023
```
Create cmmlu.py
```
  cc9778fb
- Merge pull request #913 from Muennighoff/patch-1 · 265d3414
  Stella Biderman authored Nov 01, 2023
```
Do not enforce unnecessary dependencies
```
  265d3414
- Update CODEOWNERS · 0325c8ba
  Stella Biderman authored Nov 01, 2023
  
  0325c8ba
- Merge branch 'master' into cmmlu · c2bf7f32
  Stella Biderman authored Nov 01, 2023
  
  c2bf7f32
- Fixed license · b0686dd9
  Alain authored Nov 01, 2023
  
  b0686dd9
31 Oct, 2023 2 commits
- Merge pull request #1 from LorenzoMinto/master · 35bdecd3
  Matt Hoffner authored Oct 31, 2023
```
Return score from continuation logprobs
```
  35bdecd3
- Return continuation logprobs · 9b876402
  Lorenzo authored Oct 31, 2023
  
  9b876402
30 Oct, 2023 1 commit
- Dataset licenses · 99e1a450
  Alain authored Oct 03, 2023
  
  99e1a450
23 Oct, 2023 1 commit
- Merge pull request #918 from Muennighoff/patch-2 · 3ccea2b2
  Stella Biderman authored Oct 23, 2023
```
pass through low_cpu_mem_usage
```
  3ccea2b2
17 Oct, 2023 1 commit
- Merge pull request #920 from luiscosio/patch-1 · 906ef948
  Hailey Schoelkopf authored Oct 17, 2023
```
Update Dockerfile
```
  906ef948
16 Oct, 2023 1 commit
- Update Dockerfile · f5f4856b
  Luis Cosio authored Oct 15, 2023
  
  f5f4856b
14 Oct, 2023 1 commit
- pass through low_cpu_mem_usage · d98cb3d5
  Niklas Muennighoff authored Oct 14, 2023
  
  d98cb3d5
12 Oct, 2023 1 commit
- Do not enforce unnecessary dependencies · ff74b1b9
  Niklas Muennighoff authored Oct 12, 2023
  
  ff74b1b9
05 Oct, 2023 2 commits
- Update · ff24ddbd
  mgoin authored Oct 05, 2023
  
  ff24ddbd
- Merge pull request #902 from carmocca/patch-1 · e81d3cce
  Hailey Schoelkopf authored Oct 04, 2023
```
Exclude the scripts directory from the installation
```
  e81d3cce
04 Oct, 2023 2 commits
- Update setup.py · a3329027
  Carlos Mocholí authored Oct 05, 2023
  
  a3329027
- Exclude the scripts directory from the installation · 065d9074
  Carlos Mocholí authored Oct 05, 2023
```
Fixes https://github.com/Lightning-AI/lit-gpt/issues/558
Fixes https://github.com/EleutherAI/lm-evaluation-harness/issues/901
```
  065d9074
03 Oct, 2023 1 commit
- Merge pull request #889 from tmabraham/master · f2e3950b
  Hailey Schoelkopf authored Oct 03, 2023
```
Fix PubMedQA on master
```
  f2e3950b
02 Oct, 2023 1 commit
- Merge pull request #893 from EleutherAI/revert-735-licenses · e1a8b2fa
  Stella Biderman authored Oct 02, 2023
```
Revert "Dataset licenses"
```
  e1a8b2fa