Commits · 02362e6a2912e4083069df8078277ef91c24ada2 · gaoqiong / lm-evaluation-harness

05 Jul, 2023 10 commits
- Update README.md · 29940d16
  Hailey Schoelkopf authored Jul 05, 2023
  
  29940d16
- Update README.md · 33add999
  Hailey Schoelkopf authored Jul 05, 2023
  
  33add999
- check off Lambada Multilingual from task list · b5697205
  haileyschoelkopf authored Jul 05, 2023
  
  b5697205
- remove batch_size param from config · 38bd2cc8
  haileyschoelkopf authored Jul 05, 2023
  
  38bd2cc8
- Update __init__.py · 797f47c7
  Lintang Sutawika authored Jul 05, 2023
  
  797f47c7
- remove unused line in evaluator.py · 23318d0e
  haileyschoelkopf authored Jul 05, 2023
  
  23318d0e
- fix typo in copa group name · 0e5da3b0
  haileyschoelkopf authored Jul 05, 2023
  
  0e5da3b0
- add lambada_mt tasks · 9735ac34
  haileyschoelkopf authored Jul 05, 2023
  
  9735ac34
- Update qa4mre status · 42c10bd6
  Hailey Schoelkopf authored Jul 05, 2023
  
  42c10bd6
- raise ValueError when invalid task passed · 7f557daa
  haileyschoelkopf authored Jul 05, 2023
  
  7f557daa
04 Jul, 2023 4 commits
- address PR comments · b1b5239d
  Benjamin Fattori authored Jul 04, 2023
  
  b1b5239d
- Update __init__.py · d289277d
  Lintang Sutawika authored Jul 04, 2023
```
Should fix a potential error if a dataset has no `dataset_name` argument.

cc: @haileyschoelkopf
```
  d289277d
- Update doc to target and gold_alias in the config · e8bb77db
  FarzanehNakhaee authored Jul 04, 2023
  
  e8bb77db
- edit doc to text in yaml file · ccae768a
  FarzanehNakhaee authored Jul 04, 2023
  
  ccae768a
03 Jul, 2023 18 commits
- update task readme with completed race · 026d2c21
  Benjamin Fattori authored Jul 04, 2023
  
  026d2c21
- acc_norm not needed for pubmed_qa · 81bdd5bd
  Benjamin Fattori authored Jul 04, 2023
  
  81bdd5bd
- cleanup metric loading code · 328f0e85
  haileyschoelkopf authored Jul 03, 2023
  
  328f0e85
- update race preprocess + rename dataset · 2411c9d3
  Benjamin Fattori authored Jul 03, 2023
  
  2411c9d3
- add race task, with custom HF dataset · 7feab5e3
  Benjamin Fattori authored Jul 03, 2023
  
  7feab5e3
- remove output_base_path · 6a2620ad
  haileyschoelkopf authored Jul 03, 2023
  
  6a2620ad
- Update README.md · 070b6b9c
  Hailey Schoelkopf authored Jul 03, 2023
  
  070b6b9c
- add up-to-date config fields to docs · 97220c9b
  haileyschoelkopf authored Jul 03, 2023
  
  97220c9b
- Update task.py · 0b62e042
  Hailey Schoelkopf authored Jul 03, 2023
  
  0b62e042
- fix squeeze() in pad_and_concat · 46ca66de
  haileyschoelkopf authored Jul 03, 2023
  
  46ca66de
- don't place quantized models .to(device) · 0b896bd2
  haileyschoelkopf authored Jul 03, 2023
  
  0b896bd2
- revert typehint · b3598058
  haileyschoelkopf authored Jul 03, 2023
  
  b3598058
- revert gpus > num processes case · 5cb7af7e
  haileyschoelkopf authored Jul 03, 2023
  
  5cb7af7e
- add typehint · 62f4d663
  haileyschoelkopf authored Jul 03, 2023
  
  62f4d663
- handle device assignment better · b8154374
  haileyschoelkopf authored Jul 03, 2023
  
  b8154374
- auto-gptq -> gptq and an import warning · 1d8f782f
  gk authored Jul 04, 2023
  
  1d8f782f
- fix and gather sample logging · aeebf6f2
  haileyschoelkopf authored Jul 03, 2023
  
  aeebf6f2
- fixed super_glue and removed unused yaml config · 8737d53a
  lintangsutawika authored Jul 03, 2023
  
  8737d53a
02 Jul, 2023 4 commits
- update task readme for winogrande · 4b8e7ca7
  Benjamin Fattori authored Jul 02, 2023
  
  4b8e7ca7
- add new task type: winograd_schema · a8396b2c
  Benjamin Fattori authored Jul 02, 2023
  
  a8396b2c
- winogrande task implemented · d674c7bd
  Benjamin Fattori authored Jul 02, 2023
  
  d674c7bd
- Add PEFT, quantization, remote code, LLaMA fix · 18d842ab
  gk authored Jul 02, 2023
  
  18d842ab
01 Jul, 2023 4 commits
- Update README.md · 28da615a
  Hailey Schoelkopf authored Jul 01, 2023
  
  28da615a
- Edit yaml file · 6cc461f5
  FarzanehNakhaee authored Jul 01, 2023
  
  6cc461f5
- Add newline · b88e3618
  FarzanehNakhaee authored Jul 01, 2023
  
  b88e3618
- Update README.md · 605964ad
  Hailey Schoelkopf authored Jun 30, 2023
  
  605964ad