Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
64912d81
Commit
64912d81
authored
May 18, 2023
by
lintangsutawika
Browse files
minor edit
parent
d75da0dd
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
18 deletions
+1
-18
main.py
main.py
+1
-18
No files found.
main.py
View file @
64912d81
...
...
@@ -80,24 +80,7 @@ def main():
if
os
.
path
.
isfile
(
task
):
config
=
utils
.
load_yaml_config
(
task
)
task_names
.
append
(
config
)
# # Tas
# if args.config:
# task_names = []
# for config_files in args.config.split(","):
# config = utils.get_yaml_config(config_files)
# if args.num_fewshot != 0:
# config["num_fewshot"] = args.num_fewshot
# if args.batch_size != None:
# config["batch_size"] = args.batch_size
# task_names.append(config)
# else:
# task_names = ALL_TASKS
# else:
eval_logger
.
info
(
f
"Selected Tasks:
{
task_names
}
"
)
results
=
evaluator
.
simple_evaluate
(
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment