Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e5d7ed0c
Unverified
Commit
e5d7ed0c
authored
Jan 04, 2025
by
WangErXiao
Committed by
GitHub
Jan 04, 2025
Browse files
[V1] log GPU blocks num for MultiprocExecutor (#11656)
parent
ad0d567e
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
vllm/v1/executor/multiproc_executor.py
vllm/v1/executor/multiproc_executor.py
+1
-0
No files found.
vllm/v1/executor/multiproc_executor.py
View file @
e5d7ed0c
...
...
@@ -95,6 +95,7 @@ class MultiprocExecutor(Executor):
Initialize the KV caches and begin the model execution loop of the
underlying workers.
"""
logger
.
info
(
"# GPU blocks: %d"
,
num_gpu_blocks
)
self
.
collective_rpc
(
"initialize_cache"
,
args
=
(
num_gpu_blocks
,
))
self
.
collective_rpc
(
"compile_or_warm_up_model"
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment