Commits · 7ffa1d1bf1ac8fdd4aea3566d79bba3643f8d8d3 · gaoqiong / lm-evaluation-harness

"test/vscode:/vscode.git/clone" did not exist on "14229ccf8ff5b23272c7e07f1650534682bb0739"

06 Jul, 2023 1 commit
- Change `target_delimiter` to `fewshot_delimiter` · 7ffa1d1b
  Lintang Sutawika authored Jul 06, 2023
  
  7ffa1d1b
05 Jul, 2023 5 commits
- Update task.py · 59b047fb
  Lintang Sutawika authored Jul 05, 2023
  
  59b047fb
- Update task.py · 633fb458
  Lintang Sutawika authored Jul 05, 2023
  
  633fb458
- Merge pull request #648 from EleutherAI/edge-case-lowbits · 4f0a7e57
  Lintang Sutawika authored Jul 05, 2023
```
[Refactor] Misc. bugfixes ; edgecase quantized models
```
  4f0a7e57
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
- raise ValueError when invalid task passed · 7f557daa
  haileyschoelkopf authored Jul 05, 2023
  
  7f557daa
04 Jul, 2023 4 commits
- Merge pull request #640 from farzanehnakhaee70/add-prost-config · 66b91e02
  Lintang Sutawika authored Jul 04, 2023
```
[refactor] Add prost config
```
  66b91e02
- Merge branch 'big-refactor' into add-prost-config · 66bb89e5
  FarzanehNakhaee authored Jul 04, 2023
  
  66bb89e5
- Update doc to target and gold_alias in the config · e8bb77db
  FarzanehNakhaee authored Jul 04, 2023
  
  e8bb77db
- edit doc to text in yaml file · ccae768a
  FarzanehNakhaee authored Jul 04, 2023
  
  ccae768a
03 Jul, 2023 21 commits
- cleanup metric loading code · 328f0e85
  haileyschoelkopf authored Jul 03, 2023
  
  328f0e85
- remove output_base_path · 6a2620ad
  haileyschoelkopf authored Jul 03, 2023
  
  6a2620ad
- Update README.md · 070b6b9c
  Hailey Schoelkopf authored Jul 03, 2023
  
  070b6b9c
- Merge branch 'edge-case-lowbits' of... · 93b7a418
  haileyschoelkopf authored Jul 03, 2023
```
Merge branch 'edge-case-lowbits' of https://github.com/EleutherAI/lm-evaluation-harness into edge-case-lowbits
```
  93b7a418
- remove out-of-date description guide · 899a24c7
  haileyschoelkopf authored Jul 03, 2023
  
  899a24c7
- add up-to-date config fields to docs · 97220c9b
  haileyschoelkopf authored Jul 03, 2023
  
  97220c9b
- Update task.py · 0b62e042
  Hailey Schoelkopf authored Jul 03, 2023
  
  0b62e042
- bump torch ver. 1.7->1.8 · 445beade
  haileyschoelkopf authored Jul 03, 2023
  
  445beade
- fix squeeze() in pad_and_concat · 46ca66de
  haileyschoelkopf authored Jul 03, 2023
  
  46ca66de
- don't place quantized models .to(device) · 0b896bd2
  haileyschoelkopf authored Jul 03, 2023
  
  0b896bd2
- Merge pull request #647 from EleutherAI/handle-multigpu-errors · 0d8e206c
  Lintang Sutawika authored Jul 03, 2023
```
[Refactor] Handle `cuda:0` device assignment
```
  0d8e206c
- revert typehint · b3598058
  haileyschoelkopf authored Jul 03, 2023
  
  b3598058
- revert gpus > num processes case · 5cb7af7e
  haileyschoelkopf authored Jul 03, 2023
  
  5cb7af7e
- add typehint · 62f4d663
  haileyschoelkopf authored Jul 03, 2023
  
  62f4d663
- handle device assignment better · b8154374
  haileyschoelkopf authored Jul 03, 2023
  
  b8154374
- Merge pull request #644 from gakada/bits · 59aef189
  Hailey Schoelkopf authored Jul 03, 2023
```
Add PEFT, quantization, remote code, LLaMA fix
```
  59aef189
- auto-gptq -> gptq and an import warning · 1d8f782f
  gk authored Jul 04, 2023
  
  1d8f782f
- Merge pull request #646 from EleutherAI/fix-sample-logging · 85ebe408
  Lintang Sutawika authored Jul 03, 2023
```
[Refactor] Fix sample logging
```
  85ebe408
- fix and gather sample logging · aeebf6f2
  haileyschoelkopf authored Jul 03, 2023
  
  aeebf6f2
- Merge pull request #645 from EleutherAI/fix-super-glue · 11121ead
  Lintang Sutawika authored Jul 03, 2023
```
fixed super_glue and removed unused yaml config
```
  11121ead
- fixed super_glue and removed unused yaml config · 8737d53a
  lintangsutawika authored Jul 03, 2023
  
  8737d53a
02 Jul, 2023 2 commits
- Add PEFT, quantization, remote code, LLaMA fix · 18d842ab
  gk authored Jul 02, 2023
  
  18d842ab
- Merge pull request #638 from EleutherAI/haileyschoelkopf-patch-1 · 2ef2d35f
  Lintang Sutawika authored Jul 02, 2023
```
[Refactor] Add caveats to `parallelize=True` docs
```
  2ef2d35f
01 Jul, 2023 5 commits
- Update gitignore to resolve precommit issue · fb8324c7
  FarzanehNakhaee authored Jul 01, 2023
  
  fb8324c7
- Update README.md · 28da615a
  Hailey Schoelkopf authored Jul 01, 2023
  
  28da615a
- Edit yaml file · 6cc461f5
  FarzanehNakhaee authored Jul 01, 2023
  
  6cc461f5
- Add newline · b88e3618
  FarzanehNakhaee authored Jul 01, 2023
  
  b88e3618
- Update README.md · 605964ad
  Hailey Schoelkopf authored Jun 30, 2023
  
  605964ad
30 Jun, 2023 2 commits
- Merge pull request #639 from nikuya3/hellaswag-fix · 0fe7e8eb
  Hailey Schoelkopf authored Jun 30, 2023
```
[Refactor] HellaSwag YAML fix
```
  0fe7e8eb
- [hellaswag] cast gold label to int · 8b9e5fa8
  nikuya3 authored Jul 01, 2023
  
  8b9e5fa8