Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
5b4f175f
Unverified
Commit
5b4f175f
authored
Aug 16, 2023
by
Lintang Sutawika
Committed by
GitHub
Aug 16, 2023
Browse files
Update utils.py
parent
135b41ce
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
0 additions
and
46 deletions
+0
-46
lm_eval/tasks/truthfulqa/utils.py
lm_eval/tasks/truthfulqa/utils.py
+0
-46
No files found.
lm_eval/tasks/truthfulqa/utils.py
View file @
5b4f175f
...
@@ -169,49 +169,3 @@ def rouge(refs, preds):
...
@@ -169,49 +169,3 @@ def rouge(refs, preds):
aggregator
.
add_scores
(
scorer
.
score
(
ref
,
pred
))
aggregator
.
add_scores
(
scorer
.
score
(
ref
,
pred
))
result
=
aggregator
.
aggregate
()
result
=
aggregator
.
aggregate
()
return
{
type
:
result
[
type
].
mid
.
fmeasure
*
100
for
type
in
rouge_types
}
return
{
type
:
result
[
type
].
mid
.
fmeasure
*
100
for
type
in
rouge_types
}
# def bleurt_max(predictions, references):
# pass
# def bleurt_acc(predictions, references):
# pass
# def bleurt_diff(predictions, references):
# pass
# def bleu_max(predictions, references):
# pass
# def bleu_acc(predictions, references):
# pass
# def bleu_diff(predictions, references):
# pass
# def rouge1_max(predictions, references):
# pass
# def rouge1_acc(predictions, references):
# pass
# def rouge1_diff(predictions, references):
# pass
# def rouge2_max(predictions, references):
# pass
# def rouge2_acc(predictions, references):
# pass
# def rouge2_diff(predictions, references):
# pass
# def rougeL_max(predictions, references):
# pass
# def rougeL_acc(predictions, references):
# pass
# def rougeL_diff(predictions, references):
# pass
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment