Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
opencompass
Commits
d3de5c41
"...model/git@developer.sourcefind.cn:wangsen/mineru.git" did not exist on "46ce94ebb5c7da4e8e52b143c93212fee73dc6ab"
Unverified
Commit
d3de5c41
authored
Nov 13, 2023
by
Fengzhe Zhou
Committed by
GitHub
Nov 13, 2023
Browse files
[Sync] update model configs (#574)
parent
689ffe5b
Changes
41
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
opencompass/tasks/openicl_eval.py
opencompass/tasks/openicl_eval.py
+2
-2
No files found.
opencompass/tasks/openicl_eval.py
View file @
d3de5c41
...
...
@@ -287,7 +287,7 @@ class OpenICLEvalTask(BaseTask):
result
[
'prompt'
]
=
origin_prediction
[
'origin_prompt'
]
result
[
'origin_prediction'
]
=
pred_dicts
[
i
][
'prediction'
]
result
[
'predictions'
]
=
details
[
i
][
'pred'
]
result
[
'references'
]
=
details
[
i
][
'answer
s
'
]
result
[
'references'
]
=
details
[
i
][
'answer'
]
result
[
'correct'
]
=
details
[
i
][
'correct'
]
results
[
str
(
i
)]
=
result
return
results
...
...
@@ -324,7 +324,7 @@ class OpenICLEvalTask(BaseTask):
bpbs
=
[
value
[
'BPB'
]
for
value
in
values
]
incorrect_bpb_list
.
append
(
(
sum
(
bpbs
)
-
min
(
bpbs
))
/
(
len
(
bpbs
)
-
1
))
bpb_list
.
append
(
statistics
.
mea
n
(
bpbs
))
bpb_list
.
append
(
mi
n
(
bpbs
))
def
filters
(
origins
):
targets
=
[
target
for
target
in
origins
if
not
math
.
isnan
(
target
)]
...
...
Prev
1
2
3
Next
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment