Commits · 445beadef7ae3ec7332130ef127db333b60bf1fc · gaoqiong / lm-evaluation-harness

03 Jul, 2023 9 commits
- fix squeeze() in pad_and_concat · 46ca66de
  haileyschoelkopf authored Jul 03, 2023
  
  46ca66de
- don't place quantized models .to(device) · 0b896bd2
  haileyschoelkopf authored Jul 03, 2023
  
  0b896bd2
- revert typehint · b3598058
  haileyschoelkopf authored Jul 03, 2023
  
  b3598058
- revert gpus > num processes case · 5cb7af7e
  haileyschoelkopf authored Jul 03, 2023
  
  5cb7af7e
- add typehint · 62f4d663
  haileyschoelkopf authored Jul 03, 2023
  
  62f4d663
- handle device assignment better · b8154374
  haileyschoelkopf authored Jul 03, 2023
  
  b8154374
- auto-gptq -> gptq and an import warning · 1d8f782f
  gk authored Jul 04, 2023
  
  1d8f782f
- fix and gather sample logging · aeebf6f2
  haileyschoelkopf authored Jul 03, 2023
  
  aeebf6f2
- fixed super_glue and removed unused yaml config · 8737d53a
  lintangsutawika authored Jul 03, 2023
  
  8737d53a
02 Jul, 2023 1 commit
- Add PEFT, quantization, remote code, LLaMA fix · 18d842ab
  gk authored Jul 02, 2023
  
  18d842ab
01 Jul, 2023 2 commits
- Update README.md · 28da615a
  Hailey Schoelkopf authored Jul 01, 2023
  
  28da615a
- Update README.md · 605964ad
  Hailey Schoelkopf authored Jun 30, 2023
  
  605964ad
30 Jun, 2023 1 commit
- [hellaswag] cast gold label to int · 8b9e5fa8
  nikuya3 authored Jul 01, 2023
  
  8b9e5fa8
29 Jun, 2023 5 commits
- Fix typo · d15ee17a
  Hailey Schoelkopf authored Jun 29, 2023
  
  d15ee17a
- Update README.md · a2e1d052
  Hailey Schoelkopf authored Jun 29, 2023
  
  a2e1d052
- Remove "select_continuation_from_batch_left_padding" · 909f7346
  Hailey Schoelkopf authored Jun 29, 2023
  
  909f7346
- Update task statuses on tracking list · 4d0ac35c
  Hailey Schoelkopf authored Jun 29, 2023
  
  4d0ac35c
- remove stray print · cb5423d3
  haileyschoelkopf authored Jun 29, 2023
  
  cb5423d3
28 Jun, 2023 14 commits
- cleanup + change to name=parallelize · 1b4fc896
  haileyschoelkopf authored Jun 28, 2023
  
  1b4fc896
- add device_map options for HFLM · 23eaa2db
  haileyschoelkopf authored Jun 28, 2023
  
  23eaa2db
- make self.rank and world_size defaults more robust · 8762b07c
  haileyschoelkopf authored Jun 28, 2023
  
  8762b07c
- revert mutual info whitespace change · 03b9db6b
  haileyschoelkopf authored Jun 28, 2023
  
  03b9db6b
- clean up batched code and add comments · b250b001
  haileyschoelkopf authored Jun 28, 2023
  
  b250b001
- make OAI completions work with new generation kwargs format · 5a5442ff
  haileyschoelkopf authored Jun 28, 2023
  
  5a5442ff
- add cache hooks to API LMs · d1c5abef
  haileyschoelkopf authored Jun 28, 2023
  
  d1c5abef
- change generation_kwargs -> kwargs · 732f7ed2
  haileyschoelkopf authored Jun 28, 2023
  
  732f7ed2
- make cache-loading msg part of logger · 7ffb74ce
  haileyschoelkopf authored Jun 28, 2023
  
  7ffb74ce
- log arguments too · fb108f2e
  haileyschoelkopf authored Jun 28, 2023
  
  fb108f2e
- Update model.py · b2fb53d4
  Hailey Schoelkopf authored Jun 28, 2023
  
  b2fb53d4
- Add tqdm progress bar for cachingLM · f95b160b
  Hailey Schoelkopf authored Jun 28, 2023
  
  f95b160b
- push WIP batched multi-kwarg code · ffc3a456
  haileyschoelkopf authored Jun 28, 2023
  
  ffc3a456
- add Grouper · 83f957bc
  haileyschoelkopf authored Jun 28, 2023
  
  83f957bc
27 Jun, 2023 1 commit
- update lm_eval.models.__init__ · 2fef6bc5
  haileyschoelkopf authored Jun 27, 2023
  
  2fef6bc5
26 Jun, 2023 3 commits
- remove hf-causal model type · 4f002df5
  haileyschoelkopf authored Jun 26, 2023
  
  4f002df5
- Update evaluator.py · adef6323
  Hailey Schoelkopf authored Jun 26, 2023
  
  adef6323
- update delimiter->fewshot_delimiter · 89a5a865
  haileyschoelkopf authored Jun 26, 2023
  
  89a5a865
24 Jun, 2023 3 commits
- squeeze tensors before pad_and_concat · b3aab393
  haileyschoelkopf authored Jun 24, 2023
  
  b3aab393
- remove stale commented code · 513352ae
  haileyschoelkopf authored Jun 24, 2023
  
  513352ae
- add batched generation · dced6e96
  haileyschoelkopf authored Jun 24, 2023
  
  dced6e96
23 Jun, 2023 1 commit
- add additional err handling for get_git_commit_hash · f832c776
  haileyschoelkopf authored Jun 23, 2023
  
  f832c776