Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
56a2c8e3
Unverified
Commit
56a2c8e3
authored
Nov 01, 2023
by
Hailey Schoelkopf
Committed by
GitHub
Nov 01, 2023
Browse files
describe local dataset usage in docs
parent
06faed0c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
10 additions
and
0 deletions
+10
-0
docs/new_task_guide.md
docs/new_task_guide.md
+10
-0
No files found.
docs/new_task_guide.md
View file @
56a2c8e3
...
@@ -45,6 +45,16 @@ dataset_name: ... # the dataset configuration to use. Leave `null` if your datas
...
@@ -45,6 +45,16 @@ dataset_name: ... # the dataset configuration to use. Leave `null` if your datas
dataset_kwargs
:
null
# any extra keyword arguments that should be passed to the dataset constructor, e.g. `data_dir`.
dataset_kwargs
:
null
# any extra keyword arguments that should be passed to the dataset constructor, e.g. `data_dir`.
```
```
------------------------------
**Tip:**
To load a local dataset for evaluation, you can specify data files in the
`dataset_kwargs`
field, such as the following for JSON files:
```
dataset_path: json
dataset_name: null
dataset_kwargs:
data_files: /path/to/my/json
```
-------------------------------
Next, we'd like to tell our task what the dataset's train, validation, and test splits are named, if they exist:
Next, we'd like to tell our task what the dataset's train, validation, and test splits are named, if they exist:
```
yaml
```
yaml
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment