Commits · db42dd034a328acc6e46dc202f1f2b0e026896e4 · gaoqiong / lm-evaluation-harness

"examples/gradio_webserver.py" did not exist on "d359cda5fae1c9a6fe54ba12b940572edfbf87ac"

07 Jun, 2023 1 commit
- Remove outputs folder from git · db42dd03
  FarzanehNakhaee authored Jun 07, 2023
  
  db42dd03
05 Jun, 2023 1 commit
- Create model_guide.md · d1caf4a4
  Stella Biderman authored Jun 05, 2023
  
  d1caf4a4
02 Jun, 2023 8 commits
- push task checklist · 00d33dfe
  haileyschoelkopf authored Jun 02, 2023
  
  00d33dfe
- push many yaml seed tasks · 44eec73b
  haileyschoelkopf authored Jun 02, 2023
  
  44eec73b
- Merge branch 'big-refactor' of... · 82401c96
  haileyschoelkopf authored Jun 02, 2023
```
Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into big-refactor
```
  82401c96
- fix default .py task filters · f61974ed
  haileyschoelkopf authored Jun 02, 2023
  
  f61974ed
- Merge pull request #542 from EleutherAI/promptsource-extra · 9f62d3ac
  Lintang Sutawika authored Jun 02, 2023
```
[Refactor] Make promptsource an extra / not required for installation
```
  9f62d3ac
- Merge branch 'big-refactor' of github.com:EleutherAI/lm-evaluation-harness into promptsource-extra · 6e1238cb
  lintangsutawika authored Jun 02, 2023
  
  6e1238cb
- Update gpt2.py · e3677848
  Lintang Sutawika authored Jun 02, 2023
  
  e3677848
- adjusted to follow pre-commit conventions · 6f98c780
  lintangsutawika authored Jun 02, 2023
  
  6f98c780
01 Jun, 2023 1 commit
- add promptsource as an extra · 9329fc9b
  haileyschoelkopf authored Jun 01, 2023
  
  9329fc9b
23 May, 2023 10 commits
- better error warning · b698048d
  lintangsutawika authored May 23, 2023
  
  b698048d
- Merge pull request #488 from fattorib/multigpu-feature · 62156100
  Lintang Sutawika authored May 23, 2023
```
Data Parallelism
```
  62156100
- Merge pull request #2 from EleutherAI/multigpu-feature-minor-edits · d924ca33
  ben authored May 23, 2023
```
Multigpu feature minor edits
```
  d924ca33
- Merge branch 'multigpu-feature' into multigpu-feature-minor-edits · c77fa461
  Lintang Sutawika authored May 23, 2023
  
  c77fa461
- remove device_placement flag and fix rank/world_size assignments · 650d3c76
  Benjamin Fattori authored May 23, 2023
  
  650d3c76
- fixes · bc103ce2
  lintangsutawika authored May 23, 2023
  
  bc103ce2
- merged with conflict resolved · 9f1cb1e7
  lintangsutawika authored May 23, 2023
  
  9f1cb1e7
- Merge pull request #520 from EleutherAI/update-config · 0375b792
  Lintang Sutawika authored May 23, 2023
```
Update config
```
  0375b792
- added more promptsource examples · eb42b01b
  lintangsutawika authored May 23, 2023
  
  eb42b01b
- update · 1cf51552
  lintangsutawika authored May 23, 2023
  
  1cf51552
22 May, 2023 1 commit
- pad out all batches loglikelihood_rolling. confirmed correctness · 71388a7e
  Benjamin Fattori authored May 22, 2023
  
  71388a7e
20 May, 2023 8 commits
- Merge pull request #501 from EleutherAI/update-config · c5ed8cdc
  Lintang Sutawika authored May 20, 2023
```
Update config
```
  c5ed8cdc
- unwrap gpt2 model to get n_ctx · c10c08a2
  Benjamin Fattori authored May 20, 2023
  
  c10c08a2
- improved warning message for processes < total gpus · e4f1dfb6
  Benjamin Fattori authored May 20, 2023
  
  e4f1dfb6
- keep local changes · 80fe11d8
  Benjamin Fattori authored May 20, 2023
  
  80fe11d8
- Merge remote-tracking branch 'upstream/big-refactor' into multigpu-feature · c23dd0fd
  Benjamin Fattori authored May 20, 2023
  
  c23dd0fd
- unwrap model to get pos embs · 65127577
  Benjamin Fattori authored May 20, 2023
  
  65127577
- update README with instructions for multiGPU evals · f1372139
  Benjamin Fattori authored May 20, 2023
  
  f1372139
- Update README.md · c17e3659
  Lintang Sutawika authored May 20, 2023
  
  c17e3659
19 May, 2023 5 commits
- no need for pre-commit to check custom tags · 0996ad39
  lintangsutawika authored May 19, 2023
  
  0996ad39
- pre-commit stuff · c4c20ff5
  lintangsutawika authored May 19, 2023
  
  c4c20ff5
- able to use prompts from promptsource · e56b950a
  lintangsutawika authored May 19, 2023
  
  e56b950a
- update · 1c7521a0
  lintangsutawika authored May 19, 2023
  
  1c7521a0
- handles prompt from promptsource · 6399ef9e
  lintangsutawika authored May 19, 2023
  
  6399ef9e
18 May, 2023 5 commits
- removed · c41bb266
  lintangsutawika authored May 18, 2023
  
  c41bb266
- edit · 1405697f
  lintangsutawika authored May 18, 2023
  
  1405697f
- update fewshot_docs · c37268bb
  lintangsutawika authored May 18, 2023
  
  c37268bb
- fixed so that fewshot from argparse is passed to the task · b7f896c7
  lintangsutawika authored May 18, 2023
  
  b7f896c7
- condition if kwargs is None · 1c0a1f8e
  lintangsutawika authored May 18, 2023
  
  1c0a1f8e