Skip to content

GitLab

Commit c8b76a3d authored by lintangsutawika's avatar lintangsutawika
Browse files

edit group name

parent 96d9e38c
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 3 deletions
lm_eval/tasks/mmlu/flan_n_shot/_mmlu_flan_generative_template_yaml
View file @ c8b76a3d
group: mmlu_flan group: mmlu_flan_n_shot_generative
dataset_path: cais/mmlu dataset_path: cais/mmlu
# validation_split: validation
test_split: test test_split: test
fewshot_split: dev fewshot_split: dev
# doc_to_text: "Q: {{question.strip()}}\n(A) {{choices[0]}} (B) {{choices[1]}} (C) {{choices[2]}} (D) {{choices[3]}}\nA: " # doc_to_text: "Q: {{question.strip()}}\n(A) {{choices[0]}} (B) {{choices[1]}} (C) {{choices[2]}} (D) {{choices[3]}}\nA: "
......
lm_eval/tasks/mmlu/flan_n_shot/_mmlu_flan_loglikelihood_template_yaml
View file @ c8b76a3d
group: mmlu_flan_loglikelihood group: mmlu_flan_n_shot_loglikelihood
dataset_path: cais/mmlu dataset_path: cais/mmlu
# validation_split: validation # validation_split: validation
test_split: test test_split: test
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment