Unverified Commit 3816796e authored by Alexandre Marques's avatar Alexandre Marques Committed by GitHub
Browse files

Adds MMLU CoT, gsm8k and arc_challenge for llama instruct (#2829)

* llama-style MMLU CoT

* Refactor MMLU CoT template YAML to simplify 'until' structure

* Add GSM8K task configuration for LLaMA3 with few-shot examples

* Fix missing newline at end of MMLU CoT YAML file

* Add ARC-Challenge task configuration and processing utility

* Add additional MMLU and ARC-Challenge task variants to README

* Update README with notes on arc_challenge_llama dataset preprocessing
parent 1514ac1e
"dataset_name": "professional_psychology"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_social_sciences_tasks"
"task": "mmlu_cot_llama_professional_psychology"
"task_alias": "professional psychology"
"dataset_name": "public_relations"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_social_sciences_tasks"
"task": "mmlu_cot_llama_public_relations"
"task_alias": "public relations"
"dataset_name": "security_studies"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_social_sciences_tasks"
"task": "mmlu_cot_llama_security_studies"
"task_alias": "security studies"
"dataset_name": "sociology"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_social_sciences_tasks"
"task": "mmlu_cot_llama_sociology"
"task_alias": "sociology"
"dataset_name": "us_foreign_policy"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_social_sciences_tasks"
"task": "mmlu_cot_llama_us_foreign_policy"
"task_alias": "us foreign policy"
"dataset_name": "virology"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_other_tasks"
"task": "mmlu_cot_llama_virology"
"task_alias": "virology"
"dataset_name": "world_religions"
"description": ""
"include": "_mmlu_cot_llama_template_yaml"
"tag": "mmlu_cot_llama_humanities_tasks"
"task": "mmlu_cot_llama_world_religions"
"task_alias": "world religions"
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment