Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
norm
vllm
Commits
46958cf9
Commit
46958cf9
authored
Feb 12, 2023
by
Woosuk Kwon
Browse files
BlockAllocator -> BlockManager
parent
3be29a11
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
cacheflow/master/block_manager.py
cacheflow/master/block_manager.py
+3
-3
No files found.
cacheflow/master/block_manager.py
View file @
46958cf9
...
...
@@ -7,7 +7,7 @@ from cacheflow.sequence import SequenceStatus
from
cacheflow.utils
import
Device
class
Block
Allocato
r
:
class
Block
Manage
r
:
def
__init__
(
self
,
...
...
@@ -63,8 +63,8 @@ class BlockSpaceManager:
self
.
num_total_gpu_blocks
=
num_gpu_blocks
self
.
num_total_cpu_blocks
=
num_cpu_blocks
self
.
gpu_allocator
=
Block
Allocato
r
(
Device
.
GPU
,
block_size
,
num_gpu_blocks
)
self
.
cpu_allocator
=
Block
Allocato
r
(
Device
.
CPU
,
block_size
,
num_cpu_blocks
)
self
.
gpu_allocator
=
Block
Manage
r
(
Device
.
GPU
,
block_size
,
num_gpu_blocks
)
self
.
cpu_allocator
=
Block
Manage
r
(
Device
.
CPU
,
block_size
,
num_cpu_blocks
)
# Mapping: seq_id -> BlockTable.
self
.
block_tables
:
Dict
[
int
,
BlockTable
]
=
{}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment