Unverified Commit 110e65da authored by Baber Abbasi's avatar Baber Abbasi Committed by GitHub
Browse files

fix typo (#2820)

parent 61b63da7
...@@ -49,3 +49,4 @@ If other tasks on this dataset are already supported: ...@@ -49,3 +49,4 @@ If other tasks on this dataset are already supported:
* [ ] Have you noted which, if any, published evaluation setups are matched by this variant? * [ ] Have you noted which, if any, published evaluation setups are matched by this variant?
### Changelog ### Changelog
v2 20-MAR-2025: `humaneval_instruct`, `humaneval_instruct_64`: fixed typo in gen_prefix
include: humaneval_64.yaml include: humaneval_64.yaml
task: humaneval_64_instruct task: humaneval_64_instruct
doc_to_text: "Write a solution to the following problem and make sure that it passes the tests:\n```{{prompt}}" doc_to_text: "Write a solution to the following problem and make sure that it passes the tests:\n```{{prompt}}"
gen_prefix: "Here is the completed function:\\n```python\\n{{prompt}}\\n" gen_prefix: "Here is the completed function:\n```python\n{{prompt}}\n"
filter_list: filter_list:
- name: "create_test" - name: "create_test"
filter: filter:
- function: "custom" - function: "custom"
filter_fn: !function utils.build_predictions_instruct filter_fn: !function utils.build_predictions_instruct
metadata:
version: 2.0
include: humaneval.yaml include: humaneval.yaml
task: humaneval_instruct task: humaneval_instruct
doc_to_text: "Write a solution to the following problem and make sure that it passes the tests:\n```{{prompt}}" doc_to_text: "Write a solution to the following problem and make sure that it passes the tests:\n```{{prompt}}"
gen_prefix: "Here is the completed function:\\n```python\\n{{prompt}}\\n" gen_prefix: "Here is the completed function:\n```python\n{{prompt}}\n"
filter_list: filter_list:
- name: "create_test" - name: "create_test"
filter: filter:
- function: "custom" - function: "custom"
filter_fn: !function utils.build_predictions_instruct filter_fn: !function utils.build_predictions_instruct
metadata:
version: 2.0
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment