added lama primed and negated dataset

97e3c9fe · lintangsutawika · 7852985b · 97e3c9fe
Commit 97e3c9fe authored Apr 18, 2024 by lintangsutawika
Hide whitespace changes
Inline Side-by-side

Showing with 4 additions and 0 deletions

lm_eval/tasks/lama_primed_negated/yes_no/normal_trex.yaml lm_eval/tasks/lama_primed_negated/yes_no/normal_trex.yaml +4 -0

No files found.
--- a/lm_eval/tasks/lama_primed_negated/yes_no/normal_trex.yaml
+++ b/lm_eval/tasks/lama_primed_negated/yes_no/normal_trex.yaml
+include: _normal_yes_no_template_yaml
+task: lama_normal_trex_yes_no
+dataset_name: TREx
+test_split: high_ranked