Unverified Commit 97327e43 authored by lewtun's avatar lewtun Committed by GitHub
Browse files

Update IFEval dataset to official one (#2218)

* Update IFEval dataset to official one

This PR updates the IFEval dataset to the one hosted under the Google org: https://huggingface.co/datasets/google/IFEval

Note the main change is an updated prompt from this commit in the GitHub repo: https://github.com/google-research/google-research/commit/26d8ccdab6fec61b5c83ad6327ea8bda9e580288



* Update ifeval.yaml

---------
Co-authored-by: default avatarHailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>
parent ca3d86d6
task: ifeval
dataset_path: wis-k/instruction-following-eval
dataset_path: google/IFEval
dataset_name: null
output_type: generate_until
test_split: train
......@@ -26,4 +26,4 @@ metric_list:
aggregation: !function utils.agg_inst_level_acc
higher_is_better: true
metadata:
version: 2.0
version: 3.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment