Commits · b0f67f2c67f60f445efd731e32275202e25e7fb7 · gaoqiong / lm-evaluation-harness

07 Aug, 2023 4 commits
- added tiktoken and changed openai dependency to optional · a5d57f15
  baberabb authored Aug 07, 2023
  
  a5d57f15
- added logliklihood_rolling and fixed greedy_until · 8ad386eb
  baberabb authored Aug 07, 2023
  
  8ad386eb
- added typehints and updated docs · 331340ad
  baberabb authored Aug 07, 2023
  
  331340ad
- Update error message if task name misspelt · 7aff9b75
  baberabb authored Aug 07, 2023
  
  7aff9b75
06 Aug, 2023 1 commit
- added methods to openai · 718eaec8
  baberabb authored Aug 06, 2023
  
  718eaec8
05 Aug, 2023 1 commit
- added type hints · eabadf46
  baberabb authored Aug 05, 2023
  
  eabadf46
04 Aug, 2023 6 commits
- make AnthropicLM class still registered when missing anthropic extra · e49972b0
  haileyschoelkopf authored Aug 04, 2023
  
  e49972b0
- remove num_fewshot in table that was supposed to be removed in benchmark-scripts · 07f94446
  lintangsutawika authored Aug 04, 2023
  
  07f94446
- Update evaluator.py · fa2d592a
  Lintang Sutawika authored Aug 04, 2023
  
  fa2d592a
- pre-commit format · 2f4124fa
  lintangsutawika authored Aug 04, 2023
  
  2f4124fa
- reformat · b3a8c985
  lintangsutawika authored Aug 04, 2023
  
  b3a8c985
- Update __init__.py · 881fcf15
  Lintang Sutawika authored Aug 04, 2023
  
  881fcf15
03 Aug, 2023 1 commit
- Update huggingface.py · f40c434e
  Lintang Sutawika authored Aug 03, 2023
```
`max_length` was misdefined as a tuple.
```
  f40c434e
02 Aug, 2023 5 commits
- Update task.py · 53105bba
  Lintang Sutawika authored Aug 02, 2023
  
  53105bba
- Update __init__.py · 5decd2cb
  Lintang Sutawika authored Aug 02, 2023
  
  5decd2cb
- Update __init__.py · e5bb2d57
  Lintang Sutawika authored Aug 02, 2023
```
`anthropic` is an optional library to install but `anthropic_llms.py` is always imported.

Add a way to check if the module is imported or not.
```
  e5bb2d57
- fix to add a case for if a user add `max_length` to generation_kwargs · ba864e09
  lintangsutawika authored Aug 02, 2023
  
  ba864e09
- added logiqa, logiqa2 and loqieval tasks; fixed tests for greedy_until · 8591f089
  baberabb authored Aug 02, 2023
  
  8591f089
01 Aug, 2023 11 commits
- Update README.md · aa848227
  Hailey Schoelkopf authored Aug 01, 2023
  
  aa848227
- Update README.md · 8ebc85e8
  Lintang Sutawika authored Aug 01, 2023
  
  8ebc85e8
- update on metrics and delet files · e37698df
  lintangsutawika authored Aug 01, 2023
  
  e37698df
- added rte · 1bc408ff
  lintangsutawika authored Aug 01, 2023
  
  1bc408ff
- fix configs · 223da391
  lintangsutawika authored Aug 01, 2023
  
  223da391
- skips metrics prep if process_result is not None · 1813bf04
  lintangsutawika authored Aug 01, 2023
  
  1813bf04
- process aggregate fix · 0eb94c8b
  lintangsutawika authored Aug 01, 2023
  
  0eb94c8b
- process int label to string for greedy_until · b2598de8
  lintangsutawika authored Aug 01, 2023
  
  b2598de8
- remove comments · 8da6033f
  lintangsutawika authored Aug 01, 2023
  
  8da6033f
- fix Pile dataset name · 540d468e
  haileyschoelkopf authored Aug 01, 2023
  
  540d468e
- changed dataset_path · c8b434db
  baberabb authored Aug 01, 2023
  
  c8b434db
31 Jul, 2023 1 commit
- fixed generation_kwargs; added dependency groups to testing on CI · 471297ba
  baberabb authored Jul 31, 2023
  
  471297ba
30 Jul, 2023 1 commit
- remove temperature · c79d71fd
  baberabb authored Jul 30, 2023
  
  c79d71fd
29 Jul, 2023 3 commits
- added regex · b0cbf5d7
  baberabb authored Jul 30, 2023
  
  b0cbf5d7
- add logieval · 19f6d1bd
  baberabb authored Jul 29, 2023
  
  19f6d1bd
- added logiqa2 and loading script · 66777b63
  baberabb authored Jul 29, 2023
  
  66777b63
28 Jul, 2023 4 commits
- fixed error handling · b8510001
  baberabb authored Jul 29, 2023
  
  b8510001
- passed kwargs to client · 3a3655d6
  baberabb authored Jul 28, 2023
  
  3a3655d6
- added kwargs to client · fe358061
  baberabb authored Jul 28, 2023
  
  fe358061
- updated anthropic to new API · 8ffa0e67
  baberabb authored Jul 28, 2023
  
  8ffa0e67
27 Jul, 2023 2 commits
- skip recomputing batch size if it is maximal · 96ea9f54
  Benjamin Fattori authored Jul 27, 2023
  
  96ea9f54
- autobatching support for enc-dec · 3168fc00
  Benjamin Fattori authored Jul 27, 2023
  
  3168fc00