Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
40d3a138
Commit
40d3a138
authored
Oct 14, 2025
by
Baber
Browse files
nit
parent
2665ba68
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
11 additions
and
11 deletions
+11
-11
lm_eval/tasks/mrl/gen/_generate_config.py
lm_eval/tasks/mrl/gen/_generate_config.py
+11
-11
No files found.
lm_eval/tasks/mrl/gen/_generate_config.py
View file @
40d3a138
...
...
@@ -18,14 +18,14 @@ if __name__ == "__main__":
f
.
write
(
f
"task:
{
s
}
\n
"
)
f
.
write
(
f
"dataset_name:
{
s
}
\n
"
)
with
open
(
PARENT
/
"_global_piqa_gen.yaml"
,
"w"
)
as
f
:
f
.
write
(
"group: global_piqa_gen
\n
"
)
f
.
write
(
"task:
\n
"
)
for
s
in
subsets
:
f
.
write
(
f
" - task:
{
s
}
\n
"
)
f
.
write
(
"aggregate_metric_list:
\n
"
)
f
.
write
(
" - metric: exact_match
\n
"
)
f
.
write
(
" aggregation: mean
\n
"
)
f
.
write
(
" weight_by_size: true
\n
"
)
f
.
write
(
"metadata:
\n
"
)
f
.
write
(
" version: 1.0
\n
"
)
with
open
(
PARENT
/
"_global_piqa_gen.yaml"
,
"w"
)
as
f
:
f
.
write
(
"group: global_piqa_gen
\n
"
)
f
.
write
(
"task:
\n
"
)
for
s
in
subsets
:
f
.
write
(
f
" - task:
{
s
}
\n
"
)
f
.
write
(
"aggregate_metric_list:
\n
"
)
f
.
write
(
" - metric: exact_match
\n
"
)
f
.
write
(
" aggregation: mean
\n
"
)
f
.
write
(
" weight_by_size: true
\n
"
)
f
.
write
(
"metadata:
\n
"
)
f
.
write
(
" version: 1.0
\n
"
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment