Commits · 2bb7ce3bbc144d3572f6094c559d0fd0ecff5d98 · gaoqiong / lm-evaluation-harness

15 Jul, 2023 2 commits
- add mps · 2bb7ce3b
  baberabb authored Jul 15, 2023
  
  2bb7ce3b
- removed rnd from task.fewshot_context in write_out.py; add mps in huggingface.py · 73b2149f
  baberabb authored Jul 15, 2023
  
  73b2149f
14 Jul, 2023 16 commits
- make sure boolq works · d70f7134
  haileyschoelkopf authored Jul 14, 2023
  
  d70f7134
- override target_delimiter · a36348fa
  lintangsutawika authored Jul 14, 2023
  
  a36348fa
- fixed whitespace for target · addada53
  lintangsutawika authored Jul 14, 2023
  
  addada53
- fix error · 60acbde2
  lintangsutawika authored Jul 14, 2023
  
  60acbde2
- remove info · 1ca2c0ba
  lintangsutawika authored Jul 14, 2023
  
  1ca2c0ba
- adjustments for super_glue · b0597a94
  lintangsutawika authored Jul 14, 2023
  
  b0597a94
- formatted · f7dde0c3
  lintangsutawika authored Jul 14, 2023
  
  f7dde0c3
- fix typehints in Instance() · 7684bfa9
  haileyschoelkopf authored Jul 14, 2023
  
  7684bfa9
- don't log samples if not requested · 04c81e7d
  haileyschoelkopf authored Jul 14, 2023
  
  04c81e7d
- fix random seed issue, log_samples optional · 5fbc3f86
  haileyschoelkopf authored Jul 14, 2023
  
  5fbc3f86
- updates, corrections, and fixes to match big-refactor · ee633332
  lintangsutawika authored Jul 14, 2023
  
  ee633332
- doc_to_target and doc_to_text should also accept int · 94a49f70
  lintangsutawika authored Jul 14, 2023
  
  94a49f70
- config fixes · 248b45da
  lintangsutawika authored Jul 14, 2023
  
  248b45da
- adjustments · 70e3ed25
  lintangsutawika authored Jul 14, 2023
  
  70e3ed25
- fixes to boolq · f4efb8e5
  lintangsutawika authored Jul 14, 2023
  
  f4efb8e5
- fixes to bollq · ae41f67c
  lintangsutawika authored Jul 14, 2023
  
  ae41f67c
13 Jul, 2023 17 commits
- log all arguments per doc · 09a71562
  haileyschoelkopf authored Jul 13, 2023
  
  09a71562
- add fast tokenizer flag · 165f8493
  haileyschoelkopf authored Jul 13, 2023
  
  165f8493
- Update README.md · 98c85d73
  Hailey Schoelkopf authored Jul 13, 2023
  
  98c85d73
- doc_to_choice can run when a promptsource template is defined · ce5ec854
  lintangsutawika authored Jul 13, 2023
  
  ce5ec854
- adjust wsc · 5288813a
  lintangsutawika authored Jul 13, 2023
  
  5288813a
- process condition for doc_to_text · 82d57f65
  lintangsutawika authored Jul 13, 2023
  
  82d57f65
- fixed doc_to_choice in race · e9432fad
  lintangsutawika authored Jul 13, 2023
  
  e9432fad
- adjust headqa · 9218bcff
  lintangsutawika authored Jul 13, 2023
  
  9218bcff
- adjust mathqa · f7a3cf20
  lintangsutawika authored Jul 13, 2023
  
  f7a3cf20
- adjust mathqa · a83874e5
  lintangsutawika authored Jul 13, 2023
  
  a83874e5
- fixes and added decontaminate args · 5dd41ebe
  lintangsutawika authored Jul 13, 2023
  
  5dd41ebe
- doc_to_target should also be able to output str instead of solely int · f2b52d26
  lintangsutawika authored Jul 13, 2023
  
  f2b52d26
- reformat · c827e4ce
  lintangsutawika authored Jul 13, 2023
  
  c827e4ce
- removed gold_alias for greedy_until · d1bb50e0
  lintangsutawika authored Jul 13, 2023
  
  d1bb50e0
- minor change · 9657b04c
  lintangsutawika authored Jul 13, 2023
  
  9657b04c
- update winogrande format · 5699c7ab
  lintangsutawika authored Jul 13, 2023
  
  5699c7ab
- process focuses on doc_to_text, doc_to_target, and doc_to_choice · b7449cd9
  lintangsutawika authored Jul 13, 2023
  
  b7449cd9
12 Jul, 2023 3 commits
- superglue add yamls · 5978dc4e
  lintangsutawika authored Jul 12, 2023
  
  5978dc4e
- Update README.md · 027efa00
  Hailey Schoelkopf authored Jul 12, 2023
  
  027efa00
- Update evaluator.py · 907c99c0
  Hailey Schoelkopf authored Jul 12, 2023
  
  907c99c0
11 Jul, 2023 2 commits
- updated yamls · 622bdda1
  lintangsutawika authored Jul 11, 2023
  
  622bdda1
- fixed arc · 31c52f55
  lintangsutawika authored Jul 11, 2023
  
  31c52f55