Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
61d0f137
Commit
61d0f137
authored
Nov 28, 2023
by
lintangsutawika
Browse files
use all_headers for headers
parent
19738ed2
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
13 deletions
+6
-13
lm_eval/utils.py
lm_eval/utils.py
+6
-13
No files found.
lm_eval/utils.py
View file @
61d0f137
...
@@ -280,19 +280,7 @@ def make_table(result_dict, column: str = "results"):
...
@@ -280,19 +280,7 @@ def make_table(result_dict, column: str = "results"):
elif
column
==
"groups"
:
elif
column
==
"groups"
:
column_name
=
"Groups"
column_name
=
"Groups"
md_writer
=
MarkdownTableWriter
()
all_headers
=
[
latex_writer
=
LatexTableWriter
()
md_writer
.
headers
=
[
column_name
,
"Version"
,
"Filter"
,
"n-shot"
,
"Metric"
,
"Value"
,
""
,
"Stderr"
,
]
latex_writer
.
headers
=
[
column_name
,
column_name
,
"Version"
,
"Version"
,
"Filter"
,
"Filter"
,
...
@@ -303,6 +291,11 @@ def make_table(result_dict, column: str = "results"):
...
@@ -303,6 +291,11 @@ def make_table(result_dict, column: str = "results"):
"Stderr"
,
"Stderr"
,
]
]
md_writer
=
MarkdownTableWriter
()
latex_writer
=
LatexTableWriter
()
md_writer
.
headers
=
all_headers
latex_writer
.
headers
=
all_headers
values
=
[]
values
=
[]
for
k
,
dic
in
result_dict
[
column
].
items
():
for
k
,
dic
in
result_dict
[
column
].
items
():
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment