Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
971695be
Commit
971695be
authored
Jul 08, 2025
by
Baber
Browse files
nit
parent
646dec9e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
6 additions
and
5 deletions
+6
-5
lm_eval/config/task.py
lm_eval/config/task.py
+6
-5
No files found.
lm_eval/config/task.py
View file @
971695be
...
@@ -171,13 +171,14 @@ class TaskConfig(dict):
...
@@ -171,13 +171,14 @@ class TaskConfig(dict):
should_decontaminate
:
bool
=
False
should_decontaminate
:
bool
=
False
doc_to_decontamination_query
:
Optional
[
str
]
=
None
doc_to_decontamination_query
:
Optional
[
str
]
=
None
gen_prefix
:
Optional
[
str
]
=
None
gen_prefix
:
Optional
[
str
]
=
None
metadata
:
Optional
[
dict
]
=
(
metadata
:
Optional
[
dict
]
=
field
(
None
# by default, not used in the code. allows for users to pass arbitrary info to tasks
default_factory
=
dict
)
)
# by default, not used in the code. allows for users to pass arbitrary info to tasks
_metric_list
:
list
[
MetricConfig
]
=
None
_metric_list
:
list
[
MetricConfig
]
=
None
_filter_list
:
list
[
FilterConfig
]
=
None
_filter_list
:
list
[
FilterConfig
]
=
None
ds_cfg
:
DatasetConfig
=
None
ds_cfg
:
DatasetConfig
=
field
(
init
=
False
)
fewshot_cfg
:
FewshotConfig
=
None
fewshot_cfg
:
FewshotConfig
=
field
(
init
=
False
)
def
__post_init__
(
self
)
->
None
:
def
__post_init__
(
self
)
->
None
:
### ---setup generation kwargs--- ###
### ---setup generation kwargs--- ###
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment