"docs/vscode:/vscode.git/clone" did not exist on "211ef7878f0c8a72757fd2b0050029908bc3091a"
Unverified Commit 86bbf6ac authored by Minho Ryu's avatar Minho Ryu Committed by GitHub
Browse files

add humaneval+ and mbpp+ (#2734)

* add humaneval+ and mbpp+

* add newline at end of file
parent 9b29da00
include: humaneval.yaml
task: humaneval_plus
dataset_path: evalplus/humanevalplus
include: mbpp.yaml
task: mbpp_plus
dataset_path: evalplus/mbppplus
dataset_name: null
doc_to_text: "You are an expert Python programmer, and here is your task: {{prompt if prompt is defined else text}} Your code should pass these tests:\n\n{{test_list[0]}}\n{{test_list[1]}}\n{{test_list[2]}}\n[BEGIN]\n"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment