Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
49958a86
Commit
49958a86
authored
Oct 16, 2025
by
Baber
Browse files
gen_tok should be atleast 1
parent
8e574da2
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
0 deletions
+3
-0
lm_eval/models/vllm_causallms.py
lm_eval/models/vllm_causallms.py
+3
-0
No files found.
lm_eval/models/vllm_causallms.py
View file @
49958a86
...
...
@@ -643,6 +643,9 @@ class VLLM(TemplateLM):
default_length
=
len
(
x
)
+
max_gen_toks
if
default_length
>
self
.
max_length
:
max_gen_toks
=
self
.
max_length
-
len
(
x
)
if
max_gen_toks
<
1
:
x
=
x
[
-
(
self
.
max_length
-
1
)
:]
max_gen_toks
=
1
context_encoding_truncated
.
append
(
x
)
# create sampling params
kwargs
=
self
.
modify_gen_kwargs
(
kwargs
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment