Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
121b7096
Commit
121b7096
authored
May 02, 2022
by
Fabrizio Milo
Browse files
add pre-commit
parent
7a038118
Changes
732
Hide whitespace changes
Inline
Side-by-side
Showing
20 changed files
with
20 additions
and
20 deletions
+20
-20
tests/testdata/hendrycksTest-high_school_european_history-v0-loglikelihood
...ndrycksTest-high_school_european_history-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_european_history-v0-res.json
...ta/hendrycksTest-high_school_european_history-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_geography-v0-loglikelihood
...data/hendrycksTest-high_school_geography-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_geography-v0-res.json
.../testdata/hendrycksTest-high_school_geography-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_government_and_politics-v0-loglikelihood
...Test-high_school_government_and_politics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_government_and_politics-v0-res.json
...rycksTest-high_school_government_and_politics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_macroeconomics-v0-loglikelihood
...hendrycksTest-high_school_macroeconomics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_macroeconomics-v0-res.json
...data/hendrycksTest-high_school_macroeconomics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_mathematics-v0-loglikelihood
...ta/hendrycksTest-high_school_mathematics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_mathematics-v0-res.json
...estdata/hendrycksTest-high_school_mathematics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_microeconomics-v0-loglikelihood
...hendrycksTest-high_school_microeconomics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_microeconomics-v0-res.json
...data/hendrycksTest-high_school_microeconomics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_physics-v0-loglikelihood
...stdata/hendrycksTest-high_school_physics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_physics-v0-res.json
tests/testdata/hendrycksTest-high_school_physics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_psychology-v0-loglikelihood
...ata/hendrycksTest-high_school_psychology-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_psychology-v0-res.json
...testdata/hendrycksTest-high_school_psychology-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_statistics-v0-loglikelihood
...ata/hendrycksTest-high_school_statistics-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_statistics-v0-res.json
...testdata/hendrycksTest-high_school_statistics-v0-res.json
+1
-1
tests/testdata/hendrycksTest-high_school_us_history-v0-loglikelihood
...ata/hendrycksTest-high_school_us_history-v0-loglikelihood
+1
-1
tests/testdata/hendrycksTest-high_school_us_history-v0-res.json
...testdata/hendrycksTest-high_school_us_history-v0-res.json
+1
-1
No files found.
tests/testdata/hendrycksTest-high_school_european_history-v0-loglikelihood
View file @
121b7096
d8070e113be9d420fef5578cb69c70df4ea5118f9b18553023fd9efd5ff0b7f4
\ No newline at end of file
d8070e113be9d420fef5578cb69c70df4ea5118f9b18553023fd9efd5ff0b7f4
tests/testdata/hendrycksTest-high_school_european_history-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_european_history"
:
{
"acc"
:
0.23636363636363636
,
"acc_norm"
:
0.24242424242424243
,
"acc_norm_stderr"
:
0.03346409881055953
,
"acc_stderr"
:
0.033175059300091805
}},
"versions"
:
{
"hendrycksTest-high_school_european_history"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_european_history"
:
{
"acc"
:
0.23636363636363636
,
"acc_norm"
:
0.24242424242424243
,
"acc_norm_stderr"
:
0.03346409881055953
,
"acc_stderr"
:
0.033175059300091805
}},
"versions"
:
{
"hendrycksTest-high_school_european_history"
:
0
}}
tests/testdata/hendrycksTest-high_school_geography-v0-loglikelihood
View file @
121b7096
add45970ea3865be7c7a31f788a835949f6937ac73f699b122ca56a3431e95f8
\ No newline at end of file
add45970ea3865be7c7a31f788a835949f6937ac73f699b122ca56a3431e95f8
tests/testdata/hendrycksTest-high_school_geography-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_geography"
:
{
"acc"
:
0.2474747474747475
,
"acc_norm"
:
0.2777777777777778
,
"acc_norm_stderr"
:
0.03191178226713547
,
"acc_stderr"
:
0.03074630074212452
}},
"versions"
:
{
"hendrycksTest-high_school_geography"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_geography"
:
{
"acc"
:
0.2474747474747475
,
"acc_norm"
:
0.2777777777777778
,
"acc_norm_stderr"
:
0.03191178226713547
,
"acc_stderr"
:
0.03074630074212452
}},
"versions"
:
{
"hendrycksTest-high_school_geography"
:
0
}}
tests/testdata/hendrycksTest-high_school_government_and_politics-v0-loglikelihood
View file @
121b7096
11f40d8f48ba5cd739e21d54c3c04d3761f81df5cb7ddd77df868d24ced44b49
\ No newline at end of file
11f40d8f48ba5cd739e21d54c3c04d3761f81df5cb7ddd77df868d24ced44b49
tests/testdata/hendrycksTest-high_school_government_and_politics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_government_and_politics"
:
{
"acc"
:
0.24352331606217617
,
"acc_norm"
:
0.23834196891191708
,
"acc_norm_stderr"
:
0.03074890536390988
,
"acc_stderr"
:
0.030975436386845436
}},
"versions"
:
{
"hendrycksTest-high_school_government_and_politics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_government_and_politics"
:
{
"acc"
:
0.24352331606217617
,
"acc_norm"
:
0.23834196891191708
,
"acc_norm_stderr"
:
0.03074890536390988
,
"acc_stderr"
:
0.030975436386845436
}},
"versions"
:
{
"hendrycksTest-high_school_government_and_politics"
:
0
}}
tests/testdata/hendrycksTest-high_school_macroeconomics-v0-loglikelihood
View file @
121b7096
ce4faae2fb6628caa48f6fc74cbc848880db49e6ff51079392778a2322bcefef
\ No newline at end of file
ce4faae2fb6628caa48f6fc74cbc848880db49e6ff51079392778a2322bcefef
tests/testdata/hendrycksTest-high_school_macroeconomics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_macroeconomics"
:
{
"acc"
:
0.2230769230769231
,
"acc_norm"
:
0.22564102564102564
,
"acc_norm_stderr"
:
0.021193632525148522
,
"acc_stderr"
:
0.021107730127244
}},
"versions"
:
{
"hendrycksTest-high_school_macroeconomics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_macroeconomics"
:
{
"acc"
:
0.2230769230769231
,
"acc_norm"
:
0.22564102564102564
,
"acc_norm_stderr"
:
0.021193632525148522
,
"acc_stderr"
:
0.021107730127244
}},
"versions"
:
{
"hendrycksTest-high_school_macroeconomics"
:
0
}}
tests/testdata/hendrycksTest-high_school_mathematics-v0-loglikelihood
View file @
121b7096
ab368d16fc4648ad27940f71abd266366663f51db612f732a0b9b0eea28de9f8
\ No newline at end of file
ab368d16fc4648ad27940f71abd266366663f51db612f732a0b9b0eea28de9f8
tests/testdata/hendrycksTest-high_school_mathematics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_mathematics"
:
{
"acc"
:
0.22592592592592592
,
"acc_norm"
:
0.24814814814814815
,
"acc_norm_stderr"
:
0.0263357394040558
,
"acc_stderr"
:
0.025497532639609553
}},
"versions"
:
{
"hendrycksTest-high_school_mathematics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_mathematics"
:
{
"acc"
:
0.22592592592592592
,
"acc_norm"
:
0.24814814814814815
,
"acc_norm_stderr"
:
0.0263357394040558
,
"acc_stderr"
:
0.025497532639609553
}},
"versions"
:
{
"hendrycksTest-high_school_mathematics"
:
0
}}
tests/testdata/hendrycksTest-high_school_microeconomics-v0-loglikelihood
View file @
121b7096
513b998585ebc1ebdefca6435b7c84fd73dc36fc80321a22503467f04efed23e
\ No newline at end of file
513b998585ebc1ebdefca6435b7c84fd73dc36fc80321a22503467f04efed23e
tests/testdata/hendrycksTest-high_school_microeconomics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_microeconomics"
:
{
"acc"
:
0.24369747899159663
,
"acc_norm"
:
0.22268907563025211
,
"acc_norm_stderr"
:
0.027025433498882378
,
"acc_stderr"
:
0.027886828078380558
}},
"versions"
:
{
"hendrycksTest-high_school_microeconomics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_microeconomics"
:
{
"acc"
:
0.24369747899159663
,
"acc_norm"
:
0.22268907563025211
,
"acc_norm_stderr"
:
0.027025433498882378
,
"acc_stderr"
:
0.027886828078380558
}},
"versions"
:
{
"hendrycksTest-high_school_microeconomics"
:
0
}}
tests/testdata/hendrycksTest-high_school_physics-v0-loglikelihood
View file @
121b7096
dae59e82d3d4d8dec82239d9620b72cc47bb6efbe2f1c2f9b9d23e849c9c5e32
\ No newline at end of file
dae59e82d3d4d8dec82239d9620b72cc47bb6efbe2f1c2f9b9d23e849c9c5e32
tests/testdata/hendrycksTest-high_school_physics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_physics"
:
{
"acc"
:
0.2582781456953642
,
"acc_norm"
:
0.271523178807947
,
"acc_norm_stderr"
:
0.03631329803969653
,
"acc_stderr"
:
0.035737053147634576
}},
"versions"
:
{
"hendrycksTest-high_school_physics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_physics"
:
{
"acc"
:
0.2582781456953642
,
"acc_norm"
:
0.271523178807947
,
"acc_norm_stderr"
:
0.03631329803969653
,
"acc_stderr"
:
0.035737053147634576
}},
"versions"
:
{
"hendrycksTest-high_school_physics"
:
0
}}
tests/testdata/hendrycksTest-high_school_psychology-v0-loglikelihood
View file @
121b7096
0e4c8d13806d3696167e40544d2d114c557c10c74bc61fcb9c51bbfced0266ef
\ No newline at end of file
0e4c8d13806d3696167e40544d2d114c557c10c74bc61fcb9c51bbfced0266ef
tests/testdata/hendrycksTest-high_school_psychology-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_psychology"
:
{
"acc"
:
0.24587155963302754
,
"acc_norm"
:
0.23302752293577983
,
"acc_norm_stderr"
:
0.018125669180861493
,
"acc_stderr"
:
0.018461940968708436
}},
"versions"
:
{
"hendrycksTest-high_school_psychology"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_psychology"
:
{
"acc"
:
0.24587155963302754
,
"acc_norm"
:
0.23302752293577983
,
"acc_norm_stderr"
:
0.018125669180861493
,
"acc_stderr"
:
0.018461940968708436
}},
"versions"
:
{
"hendrycksTest-high_school_psychology"
:
0
}}
tests/testdata/hendrycksTest-high_school_statistics-v0-loglikelihood
View file @
121b7096
33d1d6eaaa2c3a944bf49d3f220a4efc328d7c3b3465b7cec40ae36d8984b75f
\ No newline at end of file
33d1d6eaaa2c3a944bf49d3f220a4efc328d7c3b3465b7cec40ae36d8984b75f
tests/testdata/hendrycksTest-high_school_statistics-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_statistics"
:
{
"acc"
:
0.2962962962962963
,
"acc_norm"
:
0.3055555555555556
,
"acc_norm_stderr"
:
0.03141554629402544
,
"acc_stderr"
:
0.03114144782353604
}},
"versions"
:
{
"hendrycksTest-high_school_statistics"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_statistics"
:
{
"acc"
:
0.2962962962962963
,
"acc_norm"
:
0.3055555555555556
,
"acc_norm_stderr"
:
0.03141554629402544
,
"acc_stderr"
:
0.03114144782353604
}},
"versions"
:
{
"hendrycksTest-high_school_statistics"
:
0
}}
tests/testdata/hendrycksTest-high_school_us_history-v0-loglikelihood
View file @
121b7096
8c65c1a28330dd001d395ac11f1bb80c3b33f5935f503e74067aef6e9e1d9d9b
\ No newline at end of file
8c65c1a28330dd001d395ac11f1bb80c3b33f5935f503e74067aef6e9e1d9d9b
tests/testdata/hendrycksTest-high_school_us_history-v0-res.json
View file @
121b7096
{
"results"
:
{
"hendrycksTest-high_school_us_history"
:
{
"acc"
:
0.29901960784313725
,
"acc_norm"
:
0.28431372549019607
,
"acc_norm_stderr"
:
0.03166009679399814
,
"acc_stderr"
:
0.03213325717373618
}},
"versions"
:
{
"hendrycksTest-high_school_us_history"
:
0
}}
\ No newline at end of file
{
"results"
:
{
"hendrycksTest-high_school_us_history"
:
{
"acc"
:
0.29901960784313725
,
"acc_norm"
:
0.28431372549019607
,
"acc_norm_stderr"
:
0.03166009679399814
,
"acc_stderr"
:
0.03213325717373618
}},
"versions"
:
{
"hendrycksTest-high_school_us_history"
:
0
}}
Prev
1
…
9
10
11
12
13
14
15
16
17
…
37
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment