Unverified Commit c7ae6df1 authored by Leo Gao's avatar Leo Gao Committed by GitHub
Browse files

Update evaluator.py

parent a6bb79b4
...@@ -26,7 +26,7 @@ def simple_evaluate(model, model_args, task_names, ...@@ -26,7 +26,7 @@ def simple_evaluate(model, model_args, task_names,
:param device: str, optional :param device: str, optional
PyTorch device (e.g. "cpu" or "cuda:0") for running models PyTorch device (e.g. "cpu" or "cuda:0") for running models
:param no_cache: bool :param no_cache: bool
Whether or not Whether or not to cache
:param limit: int, optional :param limit: int, optional
Limit the number of examples per task (only use this for testing) Limit the number of examples per task (only use this for testing)
:param bootstrap_iters: :param bootstrap_iters:
...@@ -72,7 +72,7 @@ def evaluate(lm, task_dict, provide_description, num_fewshot, limit, bootstrap_i ...@@ -72,7 +72,7 @@ def evaluate(lm, task_dict, provide_description, num_fewshot, limit, bootstrap_i
:param task_dict: dict[str, Task] :param task_dict: dict[str, Task]
Dictionary of tasks Dictionary of tasks
:param provide_description: bool :param provide_description: bool
NOT IMPLEMENTED Not implemented, and this option is deprecated and will be removed in a future version in favor of a different description providing method
:param num_fewshot: int :param num_fewshot: int
Number of examples in few-shot context Number of examples in few-shot context
:param limit: int, optional :param limit: int, optional
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment