Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
0d03a9f3
Commit
0d03a9f3
authored
Nov 28, 2023
by
lintangsutawika
Browse files
add versions
parent
bf26d979
Changes
125
Hide whitespace changes
Inline
Side-by-side
Showing
5 changed files
with
10 additions
and
0 deletions
+10
-0
lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml
lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml
+2
-0
lm_eval/tasks/xcopa/default_et.yaml
lm_eval/tasks/xcopa/default_et.yaml
+2
-0
lm_eval/tasks/xnli/xnli_common_yaml
lm_eval/tasks/xnli/xnli_common_yaml
+2
-0
lm_eval/tasks/xstorycloze/default_ar.yaml
lm_eval/tasks/xstorycloze/default_ar.yaml
+2
-0
lm_eval/tasks/xwinograd/xwinograd_common_yaml
lm_eval/tasks/xwinograd/xwinograd_common_yaml
+2
-0
No files found.
lm_eval/tasks/wmt2016/ro_en-t5_prompt.yaml
View file @
0d03a9f3
...
...
@@ -15,3 +15,5 @@ metric_list:
-
metric
:
!function
metrics.bleu
aggregation
:
!function
metrics.agg_bleu
higher_is_better
:
true
metadata
:
-
version
:
0.0
\ No newline at end of file
lm_eval/tasks/xcopa/default_et.yaml
View file @
0d03a9f3
...
...
@@ -10,3 +10,5 @@ doc_to_target: label
doc_to_choice
:
!function
utils.doc_to_choice
metric_list
:
-
metric
:
acc
metadata
:
-
version
:
0.0
\ No newline at end of file
lm_eval/tasks/xnli/xnli_common_yaml
View file @
0d03a9f3
...
...
@@ -15,3 +15,5 @@ metric_list:
- metric: acc
aggregation: mean
higher_is_better: true
metadata:
- version: 0.0
\ No newline at end of file
lm_eval/tasks/xstorycloze/default_ar.yaml
View file @
0d03a9f3
...
...
@@ -14,3 +14,5 @@ metric_list:
-
metric
:
acc
aggregation
:
mean
higher_is_better
:
true
metadata
:
-
version
:
0.0
\ No newline at end of file
lm_eval/tasks/xwinograd/xwinograd_common_yaml
View file @
0d03a9f3
...
...
@@ -16,3 +16,5 @@ metric_list:
- metric: acc
aggregation: mean
higher_is_better: true
metadata:
- version: 0.0
\ No newline at end of file
Prev
1
…
3
4
5
6
7
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment