GitLab

* Added YAML task for [task/bangla]

* brief description of the task

* Update README.md

fix

---------
Co-authored-by: Baber Abbasi <92168766+baberabb@users.noreply.github.com>

* ✨

 added an approach to use tokenizer_info endpoint from vllm
Signed-off-by: m-misiura <mmisiura@redhat.com>

* 🚧

 removed all auto-detection and tokenization logic from `LocalChatCompletion`

* pacify pre-commit

---------
Signed-off-by: m-misiura <mmisiura@redhat.com>
Co-authored-by: Baber <baber@hey.com>

* initial commit

* change to acc

* fix long-dialogue tasks

* fix versioning

* more fixes

* fix naming

* fix naming

* more renaming

* maybe a dataset fix

* fix dataset and use new dataset schema

* add README

* fix prompt and dataset naming

* lint

* remove utils.py

* lint

* more linting

* fix typo

* fix naming

* add longbenchv2

---------
Co-authored-by: Baber <baber@hey.com>

* remove math dependency from python 3.9

* bump to python 3.10

* add 3.12

* update pre-commit

* unpin datasets

* Add eqbench tasks in Spanish and Catalan

* Incremented catalan_bench and spanish_bench versions. Added 'multilingual' folder inside 'eq_bench' and moved the eqbench_ca and eqbench_es .yaml to that folder. Updated the tasks README with eqbench_es and eqbench_ca, expliciting inside each description both the Hugging Face link and the translation method.

* Fixed tasks table.

* remove test_task.sh and results folder

* Add utils.py to multilingual folder

* Add humaneval_infilling task

* pacify pre-commit

---------
Co-authored-by: Baber Abbasi <92168766+baberabb@users.noreply.github.com>

* register aime

* lint

---------
Co-authored-by: Baber <baber@hey.com>