Commits · 9deea116a2d32fee75d569168668ef737ff7bb9e · gaoqiong / lm-evaluation-harness

02 Jun, 2023 3 commits
- Update gpt2.py · e3677848
  Lintang Sutawika authored Jun 02, 2023
  
  e3677848
- adjusted to follow pre-commit conventions · 6f98c780
  lintangsutawika authored Jun 02, 2023
  
  6f98c780
- result_dict process · 6acc5c47
  lintangsutawika authored Jun 02, 2023
  
  6acc5c47
01 Jun, 2023 1 commit
- add promptsource as an extra · 9329fc9b
  haileyschoelkopf authored Jun 01, 2023
  
  9329fc9b
23 May, 2023 4 commits
- better error warning · b698048d
  lintangsutawika authored May 23, 2023
  
  b698048d
- remove device_placement flag and fix rank/world_size assignments · 650d3c76
  Benjamin Fattori authored May 23, 2023
  
  650d3c76
- added more promptsource examples · eb42b01b
  lintangsutawika authored May 23, 2023
  
  eb42b01b
- update · 1cf51552
  lintangsutawika authored May 23, 2023
  
  1cf51552
22 May, 2023 1 commit
- pad out all batches loglikelihood_rolling. confirmed correctness · 71388a7e
  Benjamin Fattori authored May 22, 2023
  
  71388a7e
20 May, 2023 5 commits
- unwrap gpt2 model to get n_ctx · c10c08a2
  Benjamin Fattori authored May 20, 2023
  
  c10c08a2
- improved warning message for processes < total gpus · e4f1dfb6
  Benjamin Fattori authored May 20, 2023
  
  e4f1dfb6
- keep local changes · 80fe11d8
  Benjamin Fattori authored May 20, 2023
  
  80fe11d8
- unwrap model to get pos embs · 65127577
  Benjamin Fattori authored May 20, 2023
  
  65127577
- Update README.md · c17e3659
  Lintang Sutawika authored May 20, 2023
  
  c17e3659
19 May, 2023 4 commits
- pre-commit stuff · c4c20ff5
  lintangsutawika authored May 19, 2023
  
  c4c20ff5
- able to use prompts from promptsource · e56b950a
  lintangsutawika authored May 19, 2023
  
  e56b950a
- update · 1c7521a0
  lintangsutawika authored May 19, 2023
  
  1c7521a0
- handles prompt from promptsource · 6399ef9e
  lintangsutawika authored May 19, 2023
  
  6399ef9e
18 May, 2023 6 commits
- removed · c41bb266
  lintangsutawika authored May 18, 2023
  
  c41bb266
- edit · 1405697f
  lintangsutawika authored May 18, 2023
  
  1405697f
- update fewshot_docs · c37268bb
  lintangsutawika authored May 18, 2023
  
  c37268bb
- fixed so that fewshot from argparse is passed to the task · b7f896c7
  lintangsutawika authored May 18, 2023
  
  b7f896c7
- condition if kwargs is None · 1c0a1f8e
  lintangsutawika authored May 18, 2023
  
  1c0a1f8e
- rename · 1e0d27ba
  lintangsutawika authored May 18, 2023
  
  1e0d27ba
16 May, 2023 6 commits
- updated filter process · d75da0dd
  lintangsutawika authored May 16, 2023
  
  d75da0dd
- updated filter process · c3dabb32
  lintangsutawika authored May 16, 2023
  
  c3dabb32
- set template_aliases as conditional · 4a3c1f19
  lintangsutawika authored May 16, 2023
  
  4a3c1f19
- fewshot_doc · 7d6b39ed
  lintangsutawika authored May 16, 2023
  
  7d6b39ed
- added logging process · 8d608117
  lintangsutawika authored May 16, 2023
  
  8d608117
- fixed process · 4923a7ce
  lintangsutawika authored May 16, 2023
  
  4923a7ce
15 May, 2023 10 commits
- detect if doc_to_x is a function · e786cbac
  lintangsutawika authored May 15, 2023
  
  e786cbac
- added more samples · cbbe3b23
  lintangsutawika authored May 15, 2023
  
  cbbe3b23
- can process !function · cfbfa71c
  lintangsutawika authored May 15, 2023
  
  cfbfa71c
- moved functions out and some fixes · 7aee2dff
  lintangsutawika authored May 15, 2023
  
  7aee2dff
- can process doc_to_text and doc_to_target as function · 66c58194
  lintangsutawika authored May 15, 2023
  
  66c58194
- adjustments to ALL_TASKS · 51b795cf
  lintangsutawika authored May 15, 2023
  
  51b795cf
- delete files · 64d07df7
  lintangsutawika authored May 15, 2023
  
  64d07df7
- arc yaml set as 1 group · 439c7c6c
  lintangsutawika authored May 15, 2023
  
  439c7c6c
- adjust super glue cb · a5f5d92b
  lintangsutawika authored May 15, 2023
  
  a5f5d92b
- can list other yamls to be included and loaded · 600918bb
  lintangsutawika authored May 15, 2023
  
  600918bb