Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
0003e915
Unverified
Commit
0003e915
authored
Apr 15, 2024
by
Li, Jiang
Committed by
GitHub
Apr 15, 2024
Browse files
[Misc][Minor] Fix CPU block num log in CPUExecutor. (#4088)
parent
e11e2007
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
vllm/executor/cpu_executor.py
vllm/executor/cpu_executor.py
+4
-1
No files found.
vllm/executor/cpu_executor.py
View file @
0003e915
...
...
@@ -74,7 +74,10 @@ class CPUExecutor(ExecutorBase):
# NOTE: We log here to avoid multiple logs when number of workers is
# greater than one. We could log in the engine, but not all executors
# have GPUs.
logger
.
info
(
f
"# CPU blocks:
{
num_cpu_blocks
}
"
)
# NOTE: `cpu block` for CPU backend is located on CPU memory but is
# referred as `gpu block`. Because we want to reuse the existing block
# management procedure.
logger
.
info
(
f
"# CPU blocks:
{
num_gpu_blocks
}
"
)
self
.
driver_worker
.
initialize_cache
(
num_gpu_blocks
,
num_cpu_blocks
)
def
execute_model
(
self
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment