Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
"sims/nic/i40e_bm/i40e_lan.cc" did not exist on "0ceb071a46c2bd4f0bde66dee531a7478bdbb7c7"
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/hendrycksTest-anatomy-v0-loglikelihood
tests/testdata/hendrycksTest-anatomy-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-anatomy-v0-res.json
tests/testdata/hendrycksTest-anatomy-v0-res.json
+1
-1
tests/testdata/hendrycksTest-astronomy-v0-loglikelihood
tests/testdata/hendrycksTest-astronomy-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-astronomy-v0-res.json
tests/testdata/hendrycksTest-astronomy-v0-res.json
+1
-1
tests/testdata/hendrycksTest-business_ethics-v0-loglikelihood
...s/testdata/hendrycksTest-business_ethics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-business_ethics-v0-res.json
tests/testdata/hendrycksTest-business_ethics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-clinical_knowledge-v0-loglikelihood
...estdata/hendrycksTest-clinical_knowledge-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-clinical_knowledge-v0-res.json
tests/testdata/hendrycksTest-clinical_knowledge-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_biology-v0-loglikelihood
...s/testdata/hendrycksTest-college_biology-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_biology-v0-res.json
tests/testdata/hendrycksTest-college_biology-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_chemistry-v0-loglikelihood
...testdata/hendrycksTest-college_chemistry-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_chemistry-v0-res.json
tests/testdata/hendrycksTest-college_chemistry-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_computer_science-v0-loglikelihood
...a/hendrycksTest-college_computer_science-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_computer_science-v0-res.json
...stdata/hendrycksTest-college_computer_science-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_mathematics-v0-loglikelihood
...stdata/hendrycksTest-college_mathematics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_mathematics-v0-res.json
tests/testdata/hendrycksTest-college_mathematics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_medicine-v0-loglikelihood
.../testdata/hendrycksTest-college_medicine-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_medicine-v0-res.json
tests/testdata/hendrycksTest-college_medicine-v0-res.json
+1
-1
tests/testdata/hendrycksTest-college_physics-v0-loglikelihood
...s/testdata/hendrycksTest-college_physics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-college_physics-v0-res.json
tests/testdata/hendrycksTest-college_physics-v0-res.json
+1
-1
No files found.
tests/testdata/hendrycksTest-anatomy-v0-loglikelihood
View file @
121b7096
bf05e04ed8cf61cf3aad294ed3f5a16137775ffdd20f1b129022ddffc1251768
\ No newline at end of file
bf05e04ed8cf61cf3aad294ed3f5a16137775ffdd20f1b129022ddffc1251768
tests/testdata/hendrycksTest-anatomy-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-anatomy"
:
{
"acc"
:
0.2222222222222222
,
"acc_norm"
:
0.23703703703703705
,
"acc_norm_stderr"
:
0.03673731683969506
,
"acc_stderr"
:
0.0359144408419697
}},
"versions"
:
{
"hendrycksTest-anatomy"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-anatomy"
:
{
"acc"
:
0.2222222222222222
,
"acc_norm"
:
0.23703703703703705
,
"acc_norm_stderr"
:
0.03673731683969506
,
"acc_stderr"
:
0.0359144408419697
}},
"versions"
:
{
"hendrycksTest-anatomy"
:
0
}}
tests/testdata/hendrycksTest-astronomy-v0-loglikelihood
View file @
121b7096
bed1e47127cc2893c6aef63b9a0909cca31aa351a703da2a166b01cae03c3311
\ No newline at end of file
bed1e47127cc2893c6aef63b9a0909cca31aa351a703da2a166b01cae03c3311
tests/testdata/hendrycksTest-astronomy-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-astronomy"
:
{
"acc"
:
0.2565789473684211
,
"acc_norm"
:
0.29605263157894735
,
"acc_norm_stderr"
:
0.03715062154998904
,
"acc_stderr"
:
0.0355418036802569
}},
"versions"
:
{
"hendrycksTest-astronomy"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-astronomy"
:
{
"acc"
:
0.2565789473684211
,
"acc_norm"
:
0.29605263157894735
,
"acc_norm_stderr"
:
0.03715062154998904
,
"acc_stderr"
:
0.0355418036802569
}},
"versions"
:
{
"hendrycksTest-astronomy"
:
0
}}
tests/testdata/hendrycksTest-business_ethics-v0-loglikelihood
View file @
121b7096
b3b27e9dbad587377d3c8cab1072782de883e245da93a563bd8b3099017b1fc0
\ No newline at end of file
b3b27e9dbad587377d3c8cab1072782de883e245da93a563bd8b3099017b1fc0
tests/testdata/hendrycksTest-business_ethics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-business_ethics"
:
{
"acc"
:
0.29
,
"acc_norm"
:
0.27
,
"acc_norm_stderr"
:
0.044619604333847394
,
"acc_stderr"
:
0.045604802157206845
}},
"versions"
:
{
"hendrycksTest-business_ethics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-business_ethics"
:
{
"acc"
:
0.29
,
"acc_norm"
:
0.27
,
"acc_norm_stderr"
:
0.044619604333847394
,
"acc_stderr"
:
0.045604802157206845
}},
"versions"
:
{
"hendrycksTest-business_ethics"
:
0
}}
tests/testdata/hendrycksTest-clinical_knowledge-v0-loglikelihood
View file @
121b7096
fbcb7ce507e0675d811e71e10a67c8d05a6605e29036f46776e04a6588cefbda
\ No newline at end of file
fbcb7ce507e0675d811e71e10a67c8d05a6605e29036f46776e04a6588cefbda
tests/testdata/hendrycksTest-clinical_knowledge-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-clinical_knowledge"
:
{
"acc"
:
0.23773584905660378
,
"acc_norm"
:
0.27169811320754716
,
"acc_norm_stderr"
:
0.027377706624670713
,
"acc_stderr"
:
0.02619980880756191
}},
"versions"
:
{
"hendrycksTest-clinical_knowledge"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-clinical_knowledge"
:
{
"acc"
:
0.23773584905660378
,
"acc_norm"
:
0.27169811320754716
,
"acc_norm_stderr"
:
0.027377706624670713
,
"acc_stderr"
:
0.02619980880756191
}},
"versions"
:
{
"hendrycksTest-clinical_knowledge"
:
0
}}
tests/testdata/hendrycksTest-college_biology-v0-loglikelihood
View file @
121b7096
c29e4e67ff91af29b9434884874414d1b1b32ccc32903c6b1639469b19907419
\ No newline at end of file
c29e4e67ff91af29b9434884874414d1b1b32ccc32903c6b1639469b19907419
tests/testdata/hendrycksTest-college_biology-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_biology"
:
{
"acc"
:
0.24305555555555555
,
"acc_norm"
:
0.2361111111111111
,
"acc_norm_stderr"
:
0.03551446610810826
,
"acc_stderr"
:
0.03586879280080341
}},
"versions"
:
{
"hendrycksTest-college_biology"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_biology"
:
{
"acc"
:
0.24305555555555555
,
"acc_norm"
:
0.2361111111111111
,
"acc_norm_stderr"
:
0.03551446610810826
,
"acc_stderr"
:
0.03586879280080341
}},
"versions"
:
{
"hendrycksTest-college_biology"
:
0
}}
tests/testdata/hendrycksTest-college_chemistry-v0-loglikelihood
View file @
121b7096
044752b21540db95118b8cbe7e75c4c9b8758e27df56543deaeadec7f749a28d
\ No newline at end of file
044752b21540db95118b8cbe7e75c4c9b8758e27df56543deaeadec7f749a28d
tests/testdata/hendrycksTest-college_chemistry-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_chemistry"
:
{
"acc"
:
0.28
,
"acc_norm"
:
0.26
,
"acc_norm_stderr"
:
0.04408440022768078
,
"acc_stderr"
:
0.04512608598542127
}},
"versions"
:
{
"hendrycksTest-college_chemistry"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_chemistry"
:
{
"acc"
:
0.28
,
"acc_norm"
:
0.26
,
"acc_norm_stderr"
:
0.04408440022768078
,
"acc_stderr"
:
0.04512608598542127
}},
"versions"
:
{
"hendrycksTest-college_chemistry"
:
0
}}
tests/testdata/hendrycksTest-college_computer_science-v0-loglikelihood
View file @
121b7096
4ea26ad780290429ac5a3317559c154848d662bd40532c966458ba6f2a32d0a3
\ No newline at end of file
4ea26ad780290429ac5a3317559c154848d662bd40532c966458ba6f2a32d0a3
tests/testdata/hendrycksTest-college_computer_science-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_computer_science"
:
{
"acc"
:
0.22
,
"acc_norm"
:
0.24
,
"acc_norm_stderr"
:
0.04292346959909282
,
"acc_stderr"
:
0.041633319989322695
}},
"versions"
:
{
"hendrycksTest-college_computer_science"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_computer_science"
:
{
"acc"
:
0.22
,
"acc_norm"
:
0.24
,
"acc_norm_stderr"
:
0.04292346959909282
,
"acc_stderr"
:
0.041633319989322695
}},
"versions"
:
{
"hendrycksTest-college_computer_science"
:
0
}}
tests/testdata/hendrycksTest-college_mathematics-v0-loglikelihood
View file @
121b7096
e9fe80752686527281f834d2397875b4580581434b94799f9de6aaa450bd73ff
\ No newline at end of file
e9fe80752686527281f834d2397875b4580581434b94799f9de6aaa450bd73ff
tests/testdata/hendrycksTest-college_mathematics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_mathematics"
:
{
"acc"
:
0.18
,
"acc_norm"
:
0.2
,
"acc_norm_stderr"
:
0.04020151261036844
,
"acc_stderr"
:
0.038612291966536955
}},
"versions"
:
{
"hendrycksTest-college_mathematics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_mathematics"
:
{
"acc"
:
0.18
,
"acc_norm"
:
0.2
,
"acc_norm_stderr"
:
0.04020151261036844
,
"acc_stderr"
:
0.038612291966536955
}},
"versions"
:
{
"hendrycksTest-college_mathematics"
:
0
}}
tests/testdata/hendrycksTest-college_medicine-v0-loglikelihood
View file @
121b7096
dd6e0a9be1407890e9f8cd4434fb6aa4752ab3d2473837fd465ad99f60ad685e
\ No newline at end of file
dd6e0a9be1407890e9f8cd4434fb6aa4752ab3d2473837fd465ad99f60ad685e
tests/testdata/hendrycksTest-college_medicine-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_medicine"
:
{
"acc"
:
0.27167630057803466
,
"acc_norm"
:
0.2543352601156069
,
"acc_norm_stderr"
:
0.0332055644308557
,
"acc_stderr"
:
0.03391750322321659
}},
"versions"
:
{
"hendrycksTest-college_medicine"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_medicine"
:
{
"acc"
:
0.27167630057803466
,
"acc_norm"
:
0.2543352601156069
,
"acc_norm_stderr"
:
0.0332055644308557
,
"acc_stderr"
:
0.03391750322321659
}},
"versions"
:
{
"hendrycksTest-college_medicine"
:
0
}}
tests/testdata/hendrycksTest-college_physics-v0-loglikelihood
View file @
121b7096
704a7671ef981fb95594782bc446dd632e87ebdbe89436a0603b714fb5786c75
\ No newline at end of file
704a7671ef981fb95594782bc446dd632e87ebdbe89436a0603b714fb5786c75
tests/testdata/hendrycksTest-college_physics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-college_physics"
:
{
"acc"
:
0.23529411764705882
,
"acc_norm"
:
0.23529411764705882
,
"acc_norm_stderr"
:
0.04220773659171453
,
"acc_stderr"
:
0.04220773659171452
}},
"versions"
:
{
"hendrycksTest-college_physics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-college_physics"
:
{
"acc"
:
0.23529411764705882
,
"acc_norm"
:
0.23529411764705882
,
"acc_norm_stderr"
:
0.04220773659171453
,
"acc_stderr"
:
0.04220773659171452
}},
"versions"
:
{
"hendrycksTest-college_physics"
:
0
}}
Prev
1
…
7
8
9
10
11
12
13
14
15
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment