Skip to content

GitLab

"sgl-kernel/vscode:/vscode.git/clone" did not exist on "c7f254468fcae6a2df91765f9229aeeaf1d53613"
Commit 81bdd5bd authored by Benjamin Fattori's avatar Benjamin Fattori
Browse files

acc_norm not needed for pubmed_qa

parent 2411c9d3
Hide whitespace changes
Inline Side-by-side
Showing with 0 additions and 3 deletions
lm_eval/tasks/pubmedqa/pubmedqa.yaml
View file @ 81bdd5bd
...@@ -13,8 +13,5 @@ doc_to_target: !function preprocess_pubmedqa.doc_to_target ...@@ -13,8 +13,5 @@ doc_to_target: !function preprocess_pubmedqa.doc_to_target
gold_alias: !function preprocess_pubmedqa.gold_alias gold_alias: !function preprocess_pubmedqa.gold_alias
metric_list: metric_list:
- metric: acc - metric: acc
aggregation: mean
higher_is_better: true
- metric: acc_norm
aggregation: mean aggregation: mean
higher_is_better: true higher_is_better: true
\ No newline at end of file
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment