GitLab

[Refactor] Upstream ggml from big-refactor branch

add description on task/group alias

[Refactor] Verbosity rework

[Refactor] Bugfixes

Merge branch 'verbosity-rework' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework

[Refactor] will check if group_name is None

[Refactor] Fix CI tests

Merge branch 'port_master_squadv2' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2

[Refactor] Minor cleanup on base `Task` subclasses

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into verbosity-rework

Merge branch 'big-refactor' of https://github.com/EleutherAI/lm-evaluation-harness into port_master_squadv2

[Refactor] Alias fix

enables tasks of different group but same task_alis (for example, if evaluating on different versions of MMLU

[Refactor] fixes for alternative MMLU tasks.