Skip to content

GitLab

"example/35_splitK_gemm/CMakeLists.txt" did not exist on "2327f1a640c267743f119e59d759bc62a7887eae"
Commit 909b7b33 authored by JessicaOjo's avatar JessicaOjo
Browse files

change f1 function

parent 9af86259
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 5 deletions
lm_eval/tasks/afrixnli/en-direct/afrixnli_en_direct_yaml
View file @ 909b7b33
...@@ -20,7 +20,7 @@ should_decontaminate: true ...@@ -20,7 +20,7 @@ should_decontaminate: true
doc_to_decontamination_query: premise doc_to_decontamination_query: premise
metric_list: metric_list:
- metric: f1 - metric: f1
aggregation: f1 aggregation: !function utils.weighted_f1_score
average: weighted average: weighted
higher_is_better: True higher_is_better: True
ignore_case: true ignore_case: true
...@@ -30,8 +30,5 @@ metric_list: ...@@ -30,8 +30,5 @@ metric_list:
higher_is_better: true higher_is_better: true
ignore_case: true ignore_case: true
ignore_punctuation: true ignore_punctuation: true
regexes_to_ignore:
- ","
- "\\$"
metadata: metadata:
version: 1.0 version: 1.0
lm_eval/tasks/afrixnli/native-direct/afrixnli_native_direct_yaml
View file @ 909b7b33
...@@ -11,7 +11,7 @@ doc_to_target: label ...@@ -11,7 +11,7 @@ doc_to_target: label
doc_to_text: "" doc_to_text: ""
metric_list: metric_list:
- metric: f1 - metric: f1
aggregation: f1 aggregation: !function utils.weighted_f1_score
average: weighted average: weighted
higher_is_better: True higher_is_better: True
ignore_case: true ignore_case: true
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment