Commit 016615fa authored by lintangsutawika's avatar lintangsutawika
Browse files

Merge branch 'group-agg-rework' of...

Merge branch 'group-agg-rework' of https://github.com/EleutherAI/lm-evaluation-harness into group-agg-rework
parents e8f49184 ed1f7574
...@@ -318,7 +318,7 @@ Tasks are configured via the `TaskConfig` object. Below, we describe all fields ...@@ -318,7 +318,7 @@ Tasks are configured via the `TaskConfig` object. Below, we describe all fields
- **metric_alias** - Still in Development - **metric_alias** - Still in Development
- **version** (`int`, defaults to `0`) - Version of group config. - **version** (`int`, defaults to `0`) - Version of group config.
The simplest usage of a group yaml is to just list all tasks we want in one group. The simplest usage of a group yaml is to just list all tasks we want in one group. This ends up with behavior analogous to a `tag`--it is predominantly a way to invoke a group of tasks one expects to frequently call in conjunction with one another.
```yaml ```yaml
group: pythia group: pythia
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment