Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
c7ae6df1
Unverified
Commit
c7ae6df1
authored
Dec 08, 2021
by
Leo Gao
Committed by
GitHub
Dec 08, 2021
Browse files
Update evaluator.py
parent
a6bb79b4
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/evaluator.py
lm_eval/evaluator.py
+2
-2
No files found.
lm_eval/evaluator.py
View file @
c7ae6df1
...
@@ -26,7 +26,7 @@ def simple_evaluate(model, model_args, task_names,
...
@@ -26,7 +26,7 @@ def simple_evaluate(model, model_args, task_names,
:param device: str, optional
:param device: str, optional
PyTorch device (e.g. "cpu" or "cuda:0") for running models
PyTorch device (e.g. "cpu" or "cuda:0") for running models
:param no_cache: bool
:param no_cache: bool
Whether or not
Whether or not
to cache
:param limit: int, optional
:param limit: int, optional
Limit the number of examples per task (only use this for testing)
Limit the number of examples per task (only use this for testing)
:param bootstrap_iters:
:param bootstrap_iters:
...
@@ -72,7 +72,7 @@ def evaluate(lm, task_dict, provide_description, num_fewshot, limit, bootstrap_i
...
@@ -72,7 +72,7 @@ def evaluate(lm, task_dict, provide_description, num_fewshot, limit, bootstrap_i
:param task_dict: dict[str, Task]
:param task_dict: dict[str, Task]
Dictionary of tasks
Dictionary of tasks
:param provide_description: bool
:param provide_description: bool
N
OT IMPLEMENTED
N
ot implemented, and this option is deprecated and will be removed in a future version in favor of a different description providing method
:param num_fewshot: int
:param num_fewshot: int
Number of examples in few-shot context
Number of examples in few-shot context
:param limit: int, optional
:param limit: int, optional
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment