Commits · 90ad5db7c0fdaabd0ee86d90721ca29ce80be71b · gaoqiong / lm-evaluation-harness

27 Feb, 2024 2 commits
- update name of val split in truthfulqa multilingual (#1488) · a08eb870
  Hailey Schoelkopf authored Feb 27, 2024
  
  a08eb870
- add multilingual mmlu eval (#1484) · 7cd004c4
  Zehan Li authored Feb 27, 2024
  
  7cd004c4
26 Feb, 2024 1 commit
- Apply code autoformatting with Ruff to tasks/*.py an *__init__.py (#1469) · d27c0c08
  LSinev authored Feb 26, 2024
  
  d27c0c08
13 Feb, 2024 1 commit
- Fix: task weighting by subtask size ; update Pooled Stderr formula slightly (#1427) · 620d6a15
  Hailey Schoelkopf authored Feb 13, 2024
```
* fix weight_by_size condition

* add tests, update stderr formula slightly

* apply pre-commit
```
  620d6a15
12 Feb, 2024 1 commit
- [m_mmul] added multilingual evaluation from alexandrainst/m_mmlu (#1358) · b69c67c1
  Alessandro Ercolani authored Feb 12, 2024
  
  b69c67c1
11 Feb, 2024 2 commits
- Add multilingual TruthfulQA task (#1420) · 7397b965
  Uanu authored Feb 11, 2024
  
  7397b965
- Add multilingual ARC task (#1419) · 0256c682
  Uanu authored Feb 11, 2024
  
  0256c682
05 Jan, 2024 1 commit

Add multilingual HellaSwag task (#1228) · 28bb45fb

JorgeDeCorte authored Jan 05, 2024



* add hellaswag_nl

* add other languages and update readme to hellaswag

* refactor as new task

* update readme

* add endline to yaml files and readme.md

* add group, change folder location and update yaml file

* rename default hellaswag yaml file

* fix whitespace error in some labels

* downgrade log level of whitespace checking

---------
Co-authored-by: JorgeDeCorte <jorge.decorte@ravago.be>
Co-authored-by: Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>

28bb45fb