Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
11dde990
Commit
11dde990
authored
Jun 12, 2023
by
haileyschoelkopf
Browse files
document usage of template subfolder
parent
2808c049
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
0 deletions
+5
-0
docs/new_task_guide.md
docs/new_task_guide.md
+5
-0
No files found.
docs/new_task_guide.md
View file @
11dde990
...
...
@@ -26,6 +26,11 @@ To implement a new standard task, we'll need to write a YAML file which configur
```
sh
touch
lm_eval/tasks/<dataset_name>/<my_new_task_name>.yaml
```
Or, copy the template subfolder we provide from
`templates/new_yaml_task`
:
```
sh
cp
-r
templates/new_yaml_task lm_eval/tasks/
```
and rename the folders and YAML file(s) as desired.
### Selecting and configuring a dataset
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment