Commits · 8b74beaaa78b0d77bc0893af15becdb801a1986c · gaoqiong / lm-evaluation-harness

06 Dec, 2023 4 commits
- fix z-score and print; rename script · 8b74beaa
  baberabb authored Dec 06, 2023
  
  8b74beaa
- fix errors · b99ad796
  baberabb authored Dec 06, 2023
  
  b99ad796
- nits · a4188e1d
  baberabb authored Dec 06, 2023
  
  a4188e1d
- add script to check vllm, hf equiv · f44aa85f
  baberabb authored Dec 06, 2023
  
  f44aa85f
04 Dec, 2023 19 commits
- added `_encode_pair` · dc1c816b
  baberabb authored Dec 04, 2023
  
  dc1c816b
- typo · 19f745aa
  baberabb authored Dec 04, 2023
  
  19f745aa
- Merge branch 'main' into big-refactor_dp · e86e7b27
  baberabb authored Dec 04, 2023
```
# Conflicts:
#	README.md
```
  e86e7b27
- Merge pull request #1064 from EleutherAI/haileyschoelkopf-patch-3 · 6f76ee0e
  Lintang Sutawika authored Dec 04, 2023
  
  6f76ee0e
- Merge pull request #1065 from EleutherAI/haileyschoelkopf-patch-4 · f55595c8
  Lintang Sutawika authored Dec 04, 2023
  
  f55595c8
- Update interface.md · 05835d41
  Hailey Schoelkopf authored Dec 04, 2023
  
  05835d41
- Update README.md · ab7e8192
  Stella Biderman authored Dec 04, 2023
  
  ab7e8192
- Update pyproject.toml · 4efa4a54
  Hailey Schoelkopf authored Dec 04, 2023
  
  4efa4a54
- test · c1c44651
  Stella Biderman authored Dec 04, 2023
  
  c1c44651
- Merge branch 'main' into big-refactor_dp · 5c9fb980
  Baber Abbasi authored Dec 04, 2023
  
  5c9fb980
- Merge pull request #1062 from EleutherAI/haileyschoelkopf-patch-2 · 3c75a2c7
  Lintang Sutawika authored Dec 04, 2023
  
  3c75a2c7
- minor readme updates due to refacotr · 15953e42
  Stella Biderman authored Dec 04, 2023
  
  15953e42
- Update samplers.py · 3512f742
  Hailey Schoelkopf authored Dec 04, 2023
  
  3512f742
- Merge pull request #1061 from EleutherAI/haileyschoelkopf-patch-2 · fde2b77e
  Lintang Sutawika authored Dec 04, 2023
  
  fde2b77e
- Update README.md · dea8d7bd
  Hailey Schoelkopf authored Dec 04, 2023
  
  dea8d7bd
- Merge pull request #1060 from EleutherAI/fix-mmlu · c9bbec6e
  Hailey Schoelkopf authored Dec 04, 2023
```
[Refactor] Fix fewshot cot mmlu descriptions
```
  c9bbec6e
- formatting · 57e017ff
  lintangsutawika authored Dec 04, 2023
  
  57e017ff
- add \n\n to end of description · c30b71c3
  lintangsutawika authored Dec 04, 2023
  
  c30b71c3
- add \n\n to end of description · b32b3793
  lintangsutawika authored Dec 04, 2023
  
  b32b3793
03 Dec, 2023 3 commits
- add tokenizer options to model_args · 3bb230d3
  baberabb authored Dec 03, 2023
  
  3bb230d3
- nits · d0dc5bf9
  baberabb authored Dec 03, 2023
  
  d0dc5bf9
- fix tokenizer · 1a0f57d7
  baberabb authored Dec 03, 2023
  
  1a0f57d7
02 Dec, 2023 7 commits
- add link · 2312c263
  baberabb authored Dec 02, 2023
  
  2312c263
- repetition + nit · d4d22e47
  baberabb authored Dec 02, 2023
  
  d4d22e47
- add vllm · dcf33012
  baberabb authored Dec 02, 2023
  
  dcf33012
- nits · 82dafb34
  baberabb authored Dec 02, 2023
  
  82dafb34
- nits · f45f67e4
  baberabb authored Dec 02, 2023
  
  f45f67e4
- fixup for md files · 7d5364a5
  baberabb authored Dec 02, 2023
  
  7d5364a5
- Merge branch 'big-refactor' into big-refactor_dp · 98fba5f3
  Baber Abbasi authored Dec 02, 2023
  
  98fba5f3
01 Dec, 2023 4 commits
- Merge pull request #1051 from EleutherAI/haileyschoelkopf-patch-2 · 7afae7b5
  Stella Biderman authored Dec 01, 2023
```
[Refactor] Update docs ToC
```
  7afae7b5
- Update README.md · 553db3d0
  Hailey Schoelkopf authored Dec 01, 2023
  
  553db3d0
- Update README.md · ca3afc2e
  Hailey Schoelkopf authored Dec 01, 2023
  
  ca3afc2e
- Merge pull request #1008 from EleutherAI/openai_completions · f1b64f68
  Lintang Sutawika authored Dec 01, 2023
```
[Refactor] Openai completions
```
  f1b64f68
30 Nov, 2023 3 commits
- Merge pull request #1049 from EleutherAI/StellaAthena-patch-3 · c3d97e40
  Stella Biderman authored Nov 30, 2023
```
Update README.md
```
  c3d97e40
- Update README.md · 2a5e49fe
  Stella Biderman authored Nov 30, 2023
  
  2a5e49fe
- Merge pull request #1025 from EleutherAI/more-docs · fb1c4a8a
  Hailey Schoelkopf authored Nov 30, 2023
```
[Refactor] add notebook for overview
```
  fb1c4a8a