Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
gaoqiong
lm-evaluation-harness
Commits
c4f8c40e
Unverified
Commit
c4f8c40e
authored
Dec 15, 2023
by
Yuliang Li
Committed by
GitHub
Dec 14, 2023
Browse files
Fix vllm `batch_size` type (#1128)
parent
fcb39a5a
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
lm_eval/models/vllm_causallms.py
lm_eval/models/vllm_causallms.py
+2
-2
No files found.
lm_eval/models/vllm_causallms.py
View file @
c4f8c40e
...
@@ -260,7 +260,7 @@ please install vllm via `pip install lm-eval[vllm]` or `pip install -e .[vllm]`"
...
@@ -260,7 +260,7 @@ please install vllm via `pip install lm-eval[vllm]` or `pip install -e .[vllm]`"
for
key
,
re_ord
in
re_ords
.
items
():
for
key
,
re_ord
in
re_ords
.
items
():
chunks
=
utils
.
chunks
(
chunks
=
utils
.
chunks
(
re_ord
.
get_reordered
(),
re_ord
.
get_reordered
(),
n
=
self
.
batch_size
if
self
.
batch_size
!=
"auto"
else
0
,
n
=
int
(
self
.
batch_size
)
if
self
.
batch_size
!=
"auto"
else
0
,
fn
=
None
,
fn
=
None
,
)
)
for
chunk
in
chunks
:
for
chunk
in
chunks
:
...
@@ -339,7 +339,7 @@ please install vllm via `pip install lm-eval[vllm]` or `pip install -e .[vllm]`"
...
@@ -339,7 +339,7 @@ please install vllm via `pip install lm-eval[vllm]` or `pip install -e .[vllm]`"
chunks
=
utils
.
chunks
(
chunks
=
utils
.
chunks
(
re_ord
.
get_reordered
(),
re_ord
.
get_reordered
(),
n
=
self
.
batch_size
if
self
.
batch_size
!=
"auto"
else
0
,
n
=
int
(
self
.
batch_size
)
if
self
.
batch_size
!=
"auto"
else
0
,
fn
=
None
,
fn
=
None
,
)
)
pbar
=
tqdm
(
total
=
len
(
requests
),
disable
=
disable_tqdm
)
pbar
=
tqdm
(
total
=
len
(
requests
),
disable
=
disable_tqdm
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment