Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
09ce0c02
Commit
09ce0c02
authored
Sep 15, 2023
by
haileyschoelkopf
Browse files
fix crows-pairs readme
parent
b089e5f8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
2 deletions
+1
-2
lm_eval/tasks/crows_pairs/README.md
lm_eval/tasks/crows_pairs/README.md
+1
-2
No files found.
lm_eval/tasks/crows_pairs/README.md
View file @
09ce0c02
...
...
@@ -93,10 +93,9 @@ All tasks evaluate the percentage of more-stereotypical sentences that are rated
*
[x] Is the task an existing benchmark in the literature?
*
[x] Have you referenced the original paper that introduced the task?
*
[x] If yes, does the original paper provide a reference implementation?
*
[x] The original paper does not for causal language models, so
*
[x] The original paper does not for causal language models, so
this is a novel formulation of the task for autoregressive LMs.
If other tasks on this dataset are already supported:
*
[x] Is the "Main" variant of this task clearly denoted?
*
[x] Have you provided a short sentence in a README on what each new variant adds / evaluates?
*
[x] Have you noted which, if any, published evaluation setups are matched by this variant?
*
[
x] This matches the evaluations performed in the [Pythia paper
](
https://arxiv.org/abs/2304.01373
)
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment