Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
2bc9aa6dab8ea4c5441c8de42bf822eee10f99f2
Switch branch/tag
lm-evaluation-harness
lm_eval
tasks
ruler
19 Jan, 2025
14 commits
cleanup; pass metadata
· 2bc9aa6d
Baber
authored
Jan 19, 2025
2bc9aa6d
nit
· b9614a3e
Baber
authored
Jan 19, 2025
b9614a3e
allow to pass metadata from main
· 352127ae
Baber
authored
Jan 19, 2025
352127ae
cleanup
· a74d0408
Baber
authored
Jan 19, 2025
a74d0408
cleanup
· f8f0a72d
Baber
authored
Jan 19, 2025
f8f0a72d
cleanup
· bca6918f
Baber
authored
Jan 19, 2025
bca6918f
cleanup
· 3bbc73d4
Baber
authored
Jan 19, 2025
3bbc73d4
rename
· 01d89cdc
Baber
authored
Jan 19, 2025
01d89cdc
nit
· be7be189
Baber
authored
Jan 19, 2025
be7be189
nit
· f283c335
Baber
authored
Jan 19, 2025
f283c335
nit
· 537a77fd
Baber
authored
Jan 19, 2025
537a77fd
add qa_hotpot
· 2e43c8d7
Baber
authored
Jan 19, 2025
2e43c8d7
pre-commit
· c8a3f2e2
Baber
authored
Jan 19, 2025
c8a3f2e2
add other ruler tasks
· ca9316c9
Baber
authored
Jan 19, 2025
ca9316c9
18 Jan, 2025
2 commits
add cwe
· 92953afa
Baber
authored
Jan 18, 2025
92953afa
add gen_prefix
· 7ab8b057
Baber
authored
Jan 18, 2025
7ab8b057
17 Jan, 2025
7 commits
nit
· ebccca1e
Baber
authored
Jan 17, 2025
ebccca1e
nit
· ca348256
Baber
authored
Jan 17, 2025
ca348256
fix prompt
· 684a60ad
Baber
authored
Jan 17, 2025
684a60ad
noqa
· 610e7e05
Baber
authored
Jan 17, 2025
610e7e05
add other tasks
· 0b533339
Baber
authored
Jan 17, 2025
0b533339
better api
· 764f6fb2
Baber
authored
Jan 17, 2025
764f6fb2
nit
· 37f17c3a
Baber
authored
Jan 17, 2025
37f17c3a
20 Dec, 2024
6 commits
nit
· ee4252ff
Baber
authored
Dec 20, 2024
ee4252ff
nit
· 28abec9f
Baber
authored
Dec 20, 2024
28abec9f
nit
· bf90aa7e
Baber
authored
Dec 20, 2024
bf90aa7e
add cache
· c179f7af
Baber
authored
Dec 20, 2024
c179f7af
nit
· 134b4865
Baber
authored
Dec 20, 2024
134b4865
add more ruler tasks
· f604d6c4
Baber
authored
Dec 20, 2024
f604d6c4
19 Dec, 2024
11 commits
pass tokenizer to task config
· 105ea3e1
Baber
authored
Dec 19, 2024
105ea3e1
nit
· adcacfbf
Baber
authored
Dec 19, 2024
adcacfbf
fix template
· e4a8386e
Baber
authored
Dec 19, 2024
e4a8386e
fix metric
· 5c1f194b
Baber
authored
Dec 19, 2024
5c1f194b
nit
· 6c7c413d
Baber
authored
Dec 19, 2024
6c7c413d
nit
· 1f27bd87
Baber
authored
Dec 19, 2024
1f27bd87
fix tokenizer
· bd34e852
Baber
authored
Dec 19, 2024
bd34e852
fix aggregation
· 7399dae1
Baber
authored
Dec 19, 2024
7399dae1
fix
· 19d54607
Baber
authored
Dec 19, 2024
19d54607
handle nltk punkt_tab
· 0351bb6b
Baber
authored
Dec 19, 2024
0351bb6b
add niah
· c3aaad59
Baber
authored
Dec 19, 2024
c3aaad59