Merge pull request #645 from EleutherAI/fix-super-glue

fixed super_glue and removed unused yaml config

lm_eval/tasks/super_glue/wic/utils.py

+def doc_to_text(doc):
+    return (
+        "Sentence 1: {}\nSentence 2: {}\nQuestion: Is the word '{}' used in the same way in the"
+        " two sentences above?\nAnswer:".format(
+            doc["sentence1"],
+            doc["sentence2"],
+            doc["sentence1"][doc["start1"] : doc["end1"]],
+        )
+    )
+
+
+def doc_to_target(doc):
+    return " {}".format({0: "no", 1: "yes"}[doc["label"]])

lm_eval/tasks/super_glue/wsc/t5-prompt.yaml

 group:
   - super-glue-t5-prompt
-task: t5-prompt
-reference: "From Raffel et. al. 2019"
+task: super_glue-wsc-t5-prompt
 dataset_path: super_glue
 dataset_name: wsc
 training_split: train