Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
83ca7278
Commit
83ca7278
authored
Jan 22, 2025
by
Baber
Browse files
fix max_gen_toks
parent
b56ec435
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
3 additions
and
3 deletions
+3
-3
lm_eval/tasks/ruler/cwe.yaml
lm_eval/tasks/ruler/cwe.yaml
+1
-1
lm_eval/tasks/ruler/niah_single_1.yaml
lm_eval/tasks/ruler/niah_single_1.yaml
+1
-1
lm_eval/tasks/ruler/vt.yaml
lm_eval/tasks/ruler/vt.yaml
+1
-1
No files found.
lm_eval/tasks/ruler/cwe.yaml
View file @
83ca7278
...
@@ -5,5 +5,5 @@ target_delimiter: "\n\n"
...
@@ -5,5 +5,5 @@ target_delimiter: "\n\n"
generation_kwargs
:
generation_kwargs
:
do_sample
:
false
do_sample
:
false
temperature
:
0.0
temperature
:
0.0
max_gen_toks
:
3
0
max_gen_toks
:
12
0
until
:
[]
until
:
[]
lm_eval/tasks/ruler/niah_single_1.yaml
View file @
83ca7278
...
@@ -32,7 +32,7 @@ metric_list:
...
@@ -32,7 +32,7 @@ metric_list:
generation_kwargs
:
generation_kwargs
:
do_sample
:
false
do_sample
:
false
temperature
:
0.0
temperature
:
0.0
max_gen_toks
:
64
max_gen_toks
:
128
until
:
[]
until
:
[]
repeats
:
1
repeats
:
1
metadata
:
metadata
:
...
...
lm_eval/tasks/ruler/vt.yaml
View file @
83ca7278
...
@@ -4,5 +4,5 @@ download_dataset: !function vt_utils.get_vt_dataset
...
@@ -4,5 +4,5 @@ download_dataset: !function vt_utils.get_vt_dataset
generation_kwargs
:
generation_kwargs
:
do_sample
:
false
do_sample
:
false
temperature
:
0.0
temperature
:
0.0
max_gen_toks
:
128
max_gen_toks
:
30
until
:
[]
until
:
[]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment