Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
cab4064c
Unverified
Commit
cab4064c
authored
Apr 03, 2026
by
Wentao Ye
Committed by
GitHub
Apr 04, 2026
Browse files
[Bug] Fix workspace manager `_current_workspaces` size (#38853)
Signed-off-by:
yewentao256
<
zhyanwentao@126.com
>
parent
062f1a2d
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
3 deletions
+5
-3
vllm/v1/worker/workspace.py
vllm/v1/worker/workspace.py
+5
-3
No files found.
vllm/v1/worker/workspace.py
View file @
cab4064c
...
...
@@ -31,7 +31,7 @@ _manager: "WorkspaceManager | None" = None
class
WorkspaceManager
:
"""Manager for workspace allocation.
Manages workspace buffer
s for DBO (Dual Batch Overlap) execution
.
Manages
one
workspace buffer
per active ubatch slot
.
Can be locked to prevent further growth during execution.
"""
...
...
@@ -39,7 +39,9 @@ class WorkspaceManager:
self
.
_device
=
device
# Cache num ubatches at init based on configuration (default to 1)
self
.
_num_ubatches
=
num_ubatches
if
num_ubatches
is
not
None
else
1
self
.
_current_workspaces
:
list
[
torch
.
Tensor
|
None
]
=
[
None
,
None
]
self
.
_current_workspaces
:
list
[
torch
.
Tensor
|
None
]
=
[
None
]
*
self
.
_num_ubatches
self
.
_locked
:
bool
=
False
@
staticmethod
...
...
@@ -224,7 +226,7 @@ def init_workspace_manager(
Args:
device: The device to allocate workspace on.
num_ubatches: Number of
micro-batche
s. Defaults to 1.
num_ubatches: Number of
workspace ubatch slot
s. Defaults to 1.
"""
global
_manager
if
_manager
is
not
None
:
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment