Commits · 5d3bf2e73e9356127adcccd4976e86ca2cb825bc · gaoqiong / lm-evaluation-harness

28 Nov, 2023 1 commit
- removed flan from the naming · 3b9640b8
  lintangsutawika authored Nov 28, 2023
  
  3b9640b8
27 Nov, 2023 15 commits
- Update README.md · 5535fbd4
  Stella Biderman authored Nov 27, 2023
  
  5535fbd4
- Update README.md · 4706fbb2
  Stella Biderman authored Nov 27, 2023
  
  4706fbb2
- Create bigbench.yml · 11129906
  Stella Biderman authored Nov 27, 2023
  
  11129906
- Create README.md · babdc8d6
  Stella Biderman authored Nov 27, 2023
  
  babdc8d6
- 'flan' in groupnames optional for all variants · 1e5ca7a4
  haileyschoelkopf authored Nov 27, 2023
  
  1e5ca7a4
- make 'bbh' a group name for flan cot 3-shot, add stopseqs · e408c2ce
  haileyschoelkopf authored Nov 27, 2023
  
  e408c2ce
- fix precommint · 7fa49671
  baberabb authored Nov 27, 2023
  
  7fa49671
- Update vllm_causallms.py · 08074cf9
  Hailey Schoelkopf authored Nov 27, 2023
  
  08074cf9
- Fix gpu_memory_utilization kwarg typing, change to conditional import · b01c4893
  Hailey Schoelkopf authored Nov 27, 2023
  
  b01c4893
- always import vllm model · d86400b5
  Hailey Schoelkopf authored Nov 27, 2023
  
  d86400b5
- add auto batching · bbd6d051
  baberabb authored Nov 27, 2023
  
  bbd6d051
- add auto batching · 37f10cad
  baberabb authored Nov 27, 2023
  
  37f10cad
- fixed how messeges are sent to chatcompletions · f66730c4
  lintangsutawika authored Nov 27, 2023
  
  f66730c4
- removed model tags · a2fd682d
  lintangsutawika authored Nov 27, 2023
  
  a2fd682d
- readd old completion api · 306e84fb
  lintangsutawika authored Nov 27, 2023
  
  306e84fb
24 Nov, 2023 5 commits
- udate · a5b65c9b
  lintangsutawika authored Nov 24, 2023
  
  a5b65c9b
- fix missing lines · b64e592d
  lintangsutawika authored Nov 24, 2023
  
  b64e592d
- gen_kwargs is parsed once · 47933b98
  lintangsutawika authored Nov 24, 2023
  
  47933b98
- update on args · fde2a1d5
  lintangsutawika authored Nov 24, 2023
  
  fde2a1d5
- update · 30296795
  lintangsutawika authored Nov 24, 2023
  
  30296795
22 Nov, 2023 8 commits
- fix args · 4f79fa7b
  baberabb authored Nov 23, 2023
  
  4f79fa7b
- fix tensor parallel · af884028
  baberabb authored Nov 23, 2023
  
  af884028
- fix imports · 5ba54539
  baberabb authored Nov 23, 2023
  
  5ba54539
- fix imports · ce164bb1
  baberabb authored Nov 23, 2023
  
  ce164bb1
- disable tqdm · 667fc837
  baberabb authored Nov 23, 2023
  
  667fc837
- fix logliklehood_rolling · ac664bce
  baberabb authored Nov 23, 2023
  
  ac664bce
- bugfix · 2362ab41
  baberabb authored Nov 22, 2023
  
  2362ab41
- fix greedy_until · e5491709
  baberabb authored Nov 22, 2023
  
  e5491709
21 Nov, 2023 10 commits
- (temp) fix import · 24f4e8d7
  baberabb authored Nov 22, 2023
  
  24f4e8d7
- bugfix · f2890cc1
  baberabb authored Nov 22, 2023
  
  f2890cc1
- bugfix · 0635af13
  baberabb authored Nov 22, 2023
  
  0635af13
- bugfix · 103a10e3
  baberabb authored Nov 21, 2023
  
  103a10e3
- add vllm model · a2920e3d
  baberabb authored Nov 21, 2023
  
  a2920e3d
- add vllm model · 3d8bc82f
  baberabb authored Nov 21, 2023
  
  3d8bc82f
- update multi-token stopsequence handling · f7873a49
  haileyschoelkopf authored Nov 21, 2023
  
  f7873a49
- fixed parsing of API returns · 12e92616
  lintangsutawika authored Nov 21, 2023
  
  12e92616
- API update · bfe69313
  lintangsutawika authored Nov 21, 2023
  
  bfe69313
- renamed greedy_until to generate_until · 9c3ba7d4
  lintangsutawika authored Nov 21, 2023
  
  9c3ba7d4
20 Nov, 2023 1 commit
- add typehints · 1e9c8b59
  baberabb authored Nov 20, 2023
  
  1e9c8b59