Commits · e0417b3bea73c2fabb3cdc8cb1029ffd79be3512 · gaoqiong / lm-evaluation-harness

06 Jul, 2023 3 commits
- revert change to template_aliases · 6fc2e148
  haileyschoelkopf authored Jul 06, 2023
  
  6fc2e148
- bugfixes + add write_out · 4e5a328e
  haileyschoelkopf authored Jul 06, 2023
  
  4e5a328e
- Change `target_delimiter` to `fewshot_delimiter` · 7ffa1d1b
  Lintang Sutawika authored Jul 06, 2023
  
  7ffa1d1b
05 Jul, 2023 3 commits
- remove batch_size param from config · 38bd2cc8
  haileyschoelkopf authored Jul 05, 2023
  
  38bd2cc8
- Update task.py · 59b047fb
  Lintang Sutawika authored Jul 05, 2023
  
  59b047fb
- Update task.py · 633fb458
  Lintang Sutawika authored Jul 05, 2023
  
  633fb458
04 Jul, 2023 1 commit
- address PR comments · b1b5239d
  Benjamin Fattori authored Jul 04, 2023
  
  b1b5239d
03 Jul, 2023 3 commits
- cleanup metric loading code · 328f0e85
  haileyschoelkopf authored Jul 03, 2023
  
  328f0e85
- add up-to-date config fields to docs · 97220c9b
  haileyschoelkopf authored Jul 03, 2023
  
  97220c9b
- Update task.py · 0b62e042
  Hailey Schoelkopf authored Jul 03, 2023
  
  0b62e042
02 Jul, 2023 1 commit
- add new task type: winograd_schema · a8396b2c
  Benjamin Fattori authored Jul 02, 2023
  
  a8396b2c
28 Jun, 2023 5 commits
- make self.rank and world_size defaults more robust · 8762b07c
  haileyschoelkopf authored Jun 28, 2023
  
  8762b07c
- revert mutual info whitespace change · 03b9db6b
  haileyschoelkopf authored Jun 28, 2023
  
  03b9db6b
- make cache-loading msg part of logger · 7ffb74ce
  haileyschoelkopf authored Jun 28, 2023
  
  7ffb74ce
- Update model.py · b2fb53d4
  Hailey Schoelkopf authored Jun 28, 2023
  
  b2fb53d4
- Add tqdm progress bar for cachingLM · f95b160b
  Hailey Schoelkopf authored Jun 28, 2023
  
  f95b160b
23 Jun, 2023 3 commits
- make fewshot_docs warning more explicit · 8d14b376
  haileyschoelkopf authored Jun 23, 2023
  
  8d14b376
- fix mutual info normalization · a68c3fa4
  haileyschoelkopf authored Jun 23, 2023
  
  a68c3fa4
- add CachingLM back · 1c0ff968
  haileyschoelkopf authored Jun 23, 2023
  
  1c0ff968
22 Jun, 2023 3 commits
- Hotfix samplers.py · 9dea125b
  Hailey Schoelkopf authored Jun 22, 2023
  
  9dea125b
- more pre-commit · b48f5205
  haileyschoelkopf authored Jun 20, 2023
  
  b48f5205
- fix small TaskConfig bugs · 1d7d3de5
  haileyschoelkopf authored Jun 20, 2023
  
  1d7d3de5
21 Jun, 2023 6 commits
- remove reference to undef `self.delimiter` · abe05c5d
  Hailey Schoelkopf authored Jun 21, 2023
  
  abe05c5d
- swap target_delimiter and fewshot_delimiter · a575d9e5
  Hailey Schoelkopf authored Jun 21, 2023
  
  a575d9e5
- Update task.py · b8cb513b
  Lintang Sutawika authored Jun 21, 2023
  
  b8cb513b
- Update samplers.py · ebbb6c00
  Lintang Sutawika authored Jun 21, 2023
  
  ebbb6c00
- Update samplers.py · b85545b0
  Lintang Sutawika authored Jun 21, 2023
```
Use `target_delimiter`
```
  b85545b0
- made two delimiter modes · 977817a0
  lintangsutawika authored Jun 21, 2023
  
  977817a0
20 Jun, 2023 4 commits
- remove old code · cbb04a20
  haileyschoelkopf authored Jun 20, 2023
  
  cbb04a20
- more pre-commit · 9cf4a104
  haileyschoelkopf authored Jun 20, 2023
  
  9cf4a104
- fix small TaskConfig bugs · be5e118b
  haileyschoelkopf authored Jun 20, 2023
  
  be5e118b
- pre-commit reformat · 24321ad8
  lintangsutawika authored Jun 20, 2023
  
  24321ad8
19 Jun, 2023 2 commits
- add description to config, remove from cmdline args · 194a806d
  haileyschoelkopf authored Jun 19, 2023
  
  194a806d
- misc fixes · 3f0afe02
  haileyschoelkopf authored Jun 19, 2023
  
  3f0afe02
16 Jun, 2023 2 commits
- update docs + rest of mcqa tasks · de21abbd
  haileyschoelkopf authored Jun 16, 2023
  
  de21abbd
- fixes for multiple_choice · 4e72f165
  lintangsutawika authored Jun 16, 2023
  
  4e72f165
15 Jun, 2023 2 commits
- Update task.py · 8c9fc6b6
  Lintang Sutawika authored Jun 15, 2023
  
  8c9fc6b6
- minor fixes to satisify pre-commit · 400c0199
  lintangsutawika authored Jun 15, 2023
  
  400c0199
14 Jun, 2023 2 commits
- Remove **self._metric_kwargs[key] from compute as it wasn't existed · c08b2d9d
  FarzanehNakhaee authored Jun 14, 2023
  
  c08b2d9d
- Fixed typo on num_fewshot · 6d355b85
  Lintang Sutawika authored Jun 14, 2023
  
  6d355b85