Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
88144079
Unverified
Commit
88144079
authored
Jan 21, 2025
by
nike00811
Committed by
GitHub
Jan 21, 2025
Browse files
fix tmlu tmlu_taiwan_specific_tasks tag (#2420)
parent
ff2c49ff
Changes
3
Hide whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
3 deletions
+3
-3
lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml
lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml
+1
-1
lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml
...val/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml
+1
-1
lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml
lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml
+1
-1
No files found.
lm_eval/tasks/tmlu/default/tmlu_driving_rule.yaml
View file @
88144079
...
...
@@ -9,7 +9,7 @@
D.
{{choices[3]}}{%
if
choices
is
defined
and
choices|length
>
4
%}
\n
E.
{{choices[4]}}{%
\
\
endif
%}{%
if
choices
is
defined
and
choices|length
>
5
%}
\n
F.
{{choices[5]}}{%
\
\
endif
%}
\n
Answer:"
"
tag"
:
"
tmlu_taiwan_specific"
"
tag"
:
"
tmlu_taiwan_specific
_tasks
"
"
include"
:
"
_default_template_yaml"
"
task"
:
"
tmlu_driving_rule"
"
task_alias"
:
"
driving
rule"
lm_eval/tasks/tmlu/default/tmlu_taiwan_tourist_resources.yaml
View file @
88144079
...
...
@@ -9,7 +9,7 @@
D.
{{choices[3]}}{%
if
choices
is
defined
and
choices|length
>
4
%}
\n
E.
{{choices[4]}}{%
\
\
endif
%}{%
if
choices
is
defined
and
choices|length
>
5
%}
\n
F.
{{choices[5]}}{%
\
\
endif
%}
\n
Answer:"
"
tag"
:
"
tmlu_taiwan_specific"
"
tag"
:
"
tmlu_taiwan_specific
_tasks
"
"
include"
:
"
_default_template_yaml"
"
task"
:
"
tmlu_taiwan_tourist_resources"
"
task_alias"
:
"
taiwan
tourist
resources"
lm_eval/tasks/tmlu/default/tmlu_teacher_qualification.yaml
View file @
88144079
...
...
@@ -9,7 +9,7 @@
D.
{{choices[3]}}{%
if
choices
is
defined
and
choices|length
>
4
%}
\n
E.
{{choices[4]}}{%
\
\
endif
%}{%
if
choices
is
defined
and
choices|length
>
5
%}
\n
F.
{{choices[5]}}{%
\
\
endif
%}
\n
Answer:"
"
tag"
:
"
tmlu_taiwan_specific"
"
tag"
:
"
tmlu_taiwan_specific
_tasks
"
"
include"
:
"
_default_template_yaml"
"
task"
:
"
tmlu_teacher_qualification"
"
task_alias"
:
"
teacher
qualification"
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment