Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
fab2a6d8
Commit
fab2a6d8
authored
Oct 11, 2021
by
Jonathan Tow
Browse files
Fix spacing issue
parent
de7d6614
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
6 deletions
+9
-6
task-guide.md
task-guide.md
+9
-6
No files found.
task-guide.md
View file @
fab2a6d8
...
@@ -102,7 +102,9 @@ There are 2 standard approaches we follow for downloading data:
...
@@ -102,7 +102,9 @@ There are 2 standard approaches we follow for downloading data:
### Formatting your Few-Shot Examples
### Formatting your Few-Shot Examples
The harness is designed to facilitate task evaluations under the few-shot setting. Here we’ll format such examples.
The harness is designed to facilitate task evaluations under the few-shot setting. Here we’ll format such examples.
<br/>
<br>
⚠️
**Multiple-Choice Formatting**
⚠️
**Multiple-Choice Formatting**
If your task is
**multiple-choice**
, just inherit from the
`MultipleChoiceTask`
class we provide.
If your task is
**multiple-choice**
, just inherit from the
`MultipleChoiceTask`
class we provide.
...
@@ -120,7 +122,8 @@ See [this task](https://github.com/EleutherAI/lm-evaluation-harness/blob/105fa97
...
@@ -120,7 +122,8 @@ See [this task](https://github.com/EleutherAI/lm-evaluation-harness/blob/105fa97
You can now skip ahead to
<a
href=
"#Registering-Your-Task"
>
registering your task
</a>
.
You can now skip ahead to
<a
href=
"#Registering-Your-Task"
>
registering your task
</a>
.
⚠️
**End Multiple-Choice Formatting**
⚠️
**End Multiple-Choice Formatting**
<br/>
<br>
In the case your task is not multiple-choice, override the following methods for your task class:
In the case your task is not multiple-choice, override the following methods for your task class:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment