GitLab

Add legal judgement prediction tasks : polyglot-ko evaluation

[ADD] KoSBi dataset

- add a prompt for the klue-ynat task
- remove unnecessary parenthesis from example answers
- reformat the code

Add `KLUE-MRC` task

Add KOLD dataset

Add perplexity task on arbitrary JSON data

Add option to dump prompts and completions to a JSON file

Evaluation Against Portion of Benchmark Data

Add results of various models in json and md format

Create output path directory if necessary

* add xcopa dataset

* add xstory_cloze dataset and run pre-commit

* fix xcopa validation and test sets

* add xwinograd dataset

* add pawsx task

* add xnli task

* update task table with recently added tasks

* remove unused metrics from paws-x

* add mgsm task and fix gsm8k

* fix gsm8k until

* update task table