Commits · cda25fef4e1df2f4bc2dab3ec6668ae9f5bf7296 · gaoqiong / lm-evaluation-harness

20 Dec, 2023 1 commit
- Error in --num_fewshot option for K-MMLU Evaluation Harness (#1178) · 12f2c5ea
  GUIJIN SON authored Dec 21, 2023
```
* update kmmlu default formatting

* Update _default_kmmlu_yaml

* Delete lm_eval/tasks/kmmlu/utils.py
```
  12f2c5ea
19 Dec, 2023 1 commit

Fix Column Naming and Dataset Naming Conventions in K-MMLU Evaluation (#1171) · 9e03d9d0

seungduk.kim.2304 authored Dec 20, 2023



* Correct column names and dataset names

* Remove kmmlu_general_physics.yaml and kmmlu_korean_language.yaml

* Update _default_kmmlu_yaml

---------
Co-authored-by: Hailey Schoelkopf <65563625+haileyschoelkopf@users.noreply.github.com>

9e03d9d0

11 Dec, 2023 2 commits
- Debugging · c256eda8
  h-albert-lee authored Dec 11, 2023
  
  c256eda8
- Change spaces to underline · 489814b7
  h-albert-lee authored Dec 11, 2023
  
  489814b7
10 Dec, 2023 6 commits
- Remove blanks at the end of a file · 4edd9c4c
  h-albert-lee authored Dec 10, 2023
  
  4edd9c4c
- reformatted with Black · 520d8ce2
  h-albert-lee authored Dec 10, 2023
  
  520d8ce2
- Modify code for flake8 · 95908d8b
  h-albert-lee authored Dec 10, 2023
  
  95908d8b
- bugfix #2 remove 'context' · 9221cb57
  h-albert-lee authored Dec 10, 2023
  
  9221cb57
- bug fix (f-string) · 7bc9b82b
  h-albert-lee authored Dec 10, 2023
  
  7bc9b82b
- update yaml config · c64da8ac
  h-albert-lee authored Dec 10, 2023
  
  c64da8ac
08 Dec, 2023 1 commit
- implementing kmmlu · 1b14602e
  h-albert-lee authored Dec 08, 2023
  
  1b14602e