Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
96b6a6d7
Unverified
Commit
96b6a6d7
authored
Apr 12, 2024
by
youkaichao
Committed by
GitHub
Apr 12, 2024
Browse files
[Bugfix] fix type hint for py 3.8 (#4036)
parent
36729bac
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
vllm/executor/executor_base.py
vllm/executor/executor_base.py
+2
-2
No files found.
vllm/executor/executor_base.py
View file @
96b6a6d7
from
abc
import
ABC
,
abstractmethod
from
typing
import
Dict
,
List
,
Optional
from
typing
import
Dict
,
List
,
Optional
,
Tuple
from
vllm.config
import
(
CacheConfig
,
DeviceConfig
,
LoRAConfig
,
ModelConfig
,
ParallelConfig
,
SchedulerConfig
,
SpeculativeConfig
,
...
...
@@ -31,7 +31,7 @@ class ExecutorBase(ABC):
raise
NotImplementedError
@
abstractmethod
def
determine_num_available_blocks
(
self
)
->
t
uple
[
int
,
int
]:
def
determine_num_available_blocks
(
self
)
->
T
uple
[
int
,
int
]:
"""Determine the number of available blocks for the GPU KV cache and
swappable CPU KV cache.
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment