Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
9b1769dd
Unverified
Commit
9b1769dd
authored
May 02, 2025
by
Cyrus Leung
Committed by
GitHub
May 01, 2025
Browse files
[Bugfix] Fix lint error (#17547)
Signed-off-by:
DarkLight1337
<
tlleungac@connect.ust.hk
>
parent
61c299f8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
2 deletions
+1
-2
vllm/config.py
vllm/config.py
+1
-2
No files found.
vllm/config.py
View file @
9b1769dd
...
@@ -4250,8 +4250,7 @@ class VllmConfig:
...
@@ -4250,8 +4250,7 @@ class VllmConfig:
elif
len
(
cuda_graph_sizes
)
>
1
:
elif
len
(
cuda_graph_sizes
)
>
1
:
batch_size_capture_list
=
sorted
(
cuda_graph_sizes
)
batch_size_capture_list
=
sorted
(
cuda_graph_sizes
)
else
:
else
:
raise
TypeError
(
raise
TypeError
(
f
"Invalid value for
{
cuda_graph_sizes
=
}
."
)
f
"Invalid value for
{
cuda_graph_sizes
=
}
."
)
if
self
.
parallel_config
.
tensor_parallel_size
>
1
and
\
if
self
.
parallel_config
.
tensor_parallel_size
>
1
and
\
self
.
compilation_config
.
pass_config
.
enable_sequence_parallelism
:
self
.
compilation_config
.
pass_config
.
enable_sequence_parallelism
:
batch_size_capture_list
=
\
batch_size_capture_list
=
\
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment