Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
7a462453
Commit
7a462453
authored
Sep 10, 2023
by
Hojjat Mokhtarabadi
Browse files
undefined type and output_type when using promptsource fixed
parent
a916afd7
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
3 deletions
+2
-3
lm_eval/tasks/__init__.py
lm_eval/tasks/__init__.py
+1
-2
scripts/write_out.py
scripts/write_out.py
+1
-1
No files found.
lm_eval/tasks/__init__.py
View file @
7a462453
...
@@ -60,8 +60,7 @@ def check_prompt_config(config: dict[str, str]) -> List[dict[str, str]]:
...
@@ -60,8 +60,7 @@ def check_prompt_config(config: dict[str, str]) -> List[dict[str, str]]:
prompt_variation
,
prompt_variation
,
]
]
)
)
},
}
**
{
"output_type"
:
"greedy_until"
},
}
}
)
)
else
:
else
:
...
...
scripts/write_out.py
View file @
7a462453
...
@@ -48,7 +48,7 @@ def main():
...
@@ -48,7 +48,7 @@ def main():
docs
=
join_iters
(
iters
)
docs
=
join_iters
(
iters
)
with
open
(
os
.
path
.
join
(
args
.
output_base_path
,
task_name
),
"w"
)
as
f
:
with
open
(
os
.
path
.
join
(
args
.
output_base_path
,
task_name
),
"w"
,
encoding
=
'utf8'
)
as
f
:
for
i
,
doc
in
(
for
i
,
doc
in
(
zip
(
range
(
args
.
num_examples
),
docs
)
zip
(
range
(
args
.
num_examples
),
docs
)
if
args
.
num_examples
>
0
if
args
.
num_examples
>
0
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment