Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
ca348256
Commit
ca348256
authored
Jan 17, 2025
by
Baber
Browse files
nit
parent
684a60ad
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/tasks/ruler/utils.py
lm_eval/tasks/ruler/utils.py
+2
-2
No files found.
lm_eval/tasks/ruler/utils.py
View file @
ca348256
...
@@ -83,7 +83,7 @@ niah_single_1 = lambda **kwargs: flatten(
...
@@ -83,7 +83,7 @@ niah_single_1 = lambda **kwargs: flatten(
for
seq
in
SEQ_LENGTHS
for
seq
in
SEQ_LENGTHS
)
)
# ruff: noqa
# ruff: noqa
niah_single_2
=
lambda
x
:
flatten
(
niah_single_2
=
lambda
**
kwargs
:
flatten
(
generate_samples
(
generate_samples
(
get_haystack
(
type_haystack
=
"essay"
),
get_haystack
(
type_haystack
=
"essay"
),
max_seq_length
=
seq
,
max_seq_length
=
seq
,
...
@@ -91,7 +91,7 @@ niah_single_2 = lambda x: flatten(
...
@@ -91,7 +91,7 @@ niah_single_2 = lambda x: flatten(
type_haystack
=
"essay"
,
type_haystack
=
"essay"
,
type_needle_k
=
"words"
,
type_needle_k
=
"words"
,
type_needle_v
=
"numbers"
,
type_needle_v
=
"numbers"
,
TOKENIZER
=
get_tokenizer
(
x
),
TOKENIZER
=
get_tokenizer
(
**
kwargs
),
)
)
for
seq
in
SEQ_LENGTHS
for
seq
in
SEQ_LENGTHS
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment