Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
e628a9da
Commit
e628a9da
authored
Jun 05, 2024
by
Zafir Stojanovski
Browse files
add `task_alias`
parent
bc1b75b9
Changes
16
Show whitespace changes
Inline
Side-by-side
Showing
16 changed files
with
16 additions
and
0 deletions
+16
-0
lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml
lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml
+1
-0
lm_eval/tasks/paloma/paloma_c4_100_domains.yaml
lm_eval/tasks/paloma/paloma_c4_100_domains.yaml
+1
-0
lm_eval/tasks/paloma/paloma_c4_en.yaml
lm_eval/tasks/paloma/paloma_c4_en.yaml
+1
-0
lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml
lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml
+1
-0
lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml
...l/tasks/paloma/paloma_dolma_100_programing_languages.yaml
+1
-0
lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml
lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml
+1
-0
lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml
lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml
+1
-0
lm_eval/tasks/paloma/paloma_gab.yaml
lm_eval/tasks/paloma/paloma_gab.yaml
+1
-0
lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml
lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml
+1
-0
lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml
lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml
+1
-0
lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml
lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml
+1
-0
lm_eval/tasks/paloma/paloma_mc4.yaml
lm_eval/tasks/paloma/paloma_mc4.yaml
+1
-0
lm_eval/tasks/paloma/paloma_ptb.yaml
lm_eval/tasks/paloma/paloma_ptb.yaml
+1
-0
lm_eval/tasks/paloma/paloma_redpajama.yaml
lm_eval/tasks/paloma/paloma_redpajama.yaml
+1
-0
lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml
lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml
+1
-0
lm_eval/tasks/paloma/paloma_wikitext_103.yaml
lm_eval/tasks/paloma/paloma_wikitext_103.yaml
+1
-0
No files found.
lm_eval/tasks/paloma/paloma_4chan_meta_sep.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_4chan_meta_sep
task
:
paloma_4chan_meta_sep
task_alias
:
4chan_meta_sep
dataset_name
:
4chan_meta_sep
dataset_name
:
4chan_meta_sep
lm_eval/tasks/paloma/paloma_c4_100_domains.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_c4_100_domains
task
:
paloma_c4_100_domains
task_alias
:
c4_100_domains
dataset_name
:
c4_100_domains
dataset_name
:
c4_100_domains
lm_eval/tasks/paloma/paloma_c4_en.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_c4_en
task
:
paloma_c4_en
task_alias
:
c4_en
dataset_name
:
c4_en
dataset_name
:
c4_en
lm_eval/tasks/paloma/paloma_dolma-v1_5.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_dolma-v1_5
task
:
paloma_dolma-v1_5
task_alias
:
dolma-v1_5
dataset_name
:
dolma-v1_5
dataset_name
:
dolma-v1_5
lm_eval/tasks/paloma/paloma_dolma_100_programing_languages.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_dolma_100_programing_languages
task
:
paloma_dolma_100_programing_languages
task_alias
:
dolma_100_programing_languages
dataset_name
:
dolma_100_programing_languages
dataset_name
:
dolma_100_programing_languages
lm_eval/tasks/paloma/paloma_dolma_100_subreddits.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_dolma_100_subreddits
task
:
paloma_dolma_100_subreddits
task_alias
:
dolma_100_subreddits
dataset_name
:
dolma_100_subreddits
dataset_name
:
dolma_100_subreddits
lm_eval/tasks/paloma/paloma_falcon-refinedweb.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_falcon-refinedweb
task
:
paloma_falcon-refinedweb
task_alias
:
falcon-refinedweb
dataset_name
:
falcon-refinedweb
dataset_name
:
falcon-refinedweb
lm_eval/tasks/paloma/paloma_gab.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_gab
task
:
paloma_gab
task_alias
:
gab
dataset_name
:
gab
dataset_name
:
gab
lm_eval/tasks/paloma/paloma_m2d2_s2orc_unsplit.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_m2d2_s2orc_unsplit
task
:
paloma_m2d2_s2orc_unsplit
task_alias
:
m2d2_s2orc_unsplit
dataset_name
:
m2d2_s2orc_unsplit
dataset_name
:
m2d2_s2orc_unsplit
lm_eval/tasks/paloma/paloma_m2d2_wikipedia_unsplit.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_m2d2_wikipedia_unsplit
task
:
paloma_m2d2_wikipedia_unsplit
task_alias
:
m2d2_wikipedia_unsplit
dataset_name
:
m2d2_wikipedia_unsplit
dataset_name
:
m2d2_wikipedia_unsplit
lm_eval/tasks/paloma/paloma_manosphere_meta_sep.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_manosphere_meta_sep
task
:
paloma_manosphere_meta_sep
task_alias
:
manosphere_meta_sep
dataset_name
:
manosphere_meta_sep
dataset_name
:
manosphere_meta_sep
lm_eval/tasks/paloma/paloma_mc4.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_mc4
task
:
paloma_mc4
task_alias
:
mc4
dataset_name
:
mc4
dataset_name
:
mc4
lm_eval/tasks/paloma/paloma_ptb.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_ptb
task
:
paloma_ptb
task_alias
:
ptb
dataset_name
:
ptb
dataset_name
:
ptb
lm_eval/tasks/paloma/paloma_redpajama.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_redpajama
task
:
paloma_redpajama
task_alias
:
redpajama
dataset_name
:
redpajama
dataset_name
:
redpajama
lm_eval/tasks/paloma/paloma_twitterAAE_HELM_fixed.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_twitterAAE_HELM_fixed
task
:
paloma_twitterAAE_HELM_fixed
task_alias
:
twitterAAE_HELM_fixed
dataset_name
:
twitterAAE_HELM_fixed
dataset_name
:
twitterAAE_HELM_fixed
lm_eval/tasks/paloma/paloma_wikitext_103.yaml
View file @
e628a9da
include
:
paloma.yaml
include
:
paloma.yaml
task
:
paloma_wikitext_103
task
:
paloma_wikitext_103
task_alias
:
wikitext_103
dataset_name
:
wikitext_103
dataset_name
:
wikitext_103
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment