Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
8b268a46
Unverified
Commit
8b268a46
authored
Mar 24, 2024
by
youkaichao
Committed by
GitHub
Mar 24, 2024
Browse files
[CI] typo fix: is_hip --> is_hip() (#3595)
parent
41deac4a
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
5 additions
and
5 deletions
+5
-5
tests/kernels/test_cache.py
tests/kernels/test_cache.py
+5
-5
No files found.
tests/kernels/test_cache.py
View file @
8b268a46
...
@@ -6,7 +6,6 @@ import torch
...
@@ -6,7 +6,6 @@ import torch
from
typing
import
Tuple
from
typing
import
Tuple
from
vllm._C
import
cache_ops
from
vllm._C
import
cache_ops
from
vllm.utils
import
is_hip
COPYING_DIRECTION
=
[(
'cuda'
,
'cpu'
),
(
'cuda'
,
'cuda'
),
(
'cpu'
,
'cuda'
)]
COPYING_DIRECTION
=
[(
'cuda'
,
'cpu'
),
(
'cuda'
,
'cuda'
),
(
'cpu'
,
'cuda'
)]
DTYPES
=
[
torch
.
half
,
torch
.
bfloat16
,
torch
.
float
]
DTYPES
=
[
torch
.
half
,
torch
.
bfloat16
,
torch
.
float
]
...
@@ -15,10 +14,11 @@ NUM_LAYERS = [1] # Arbitrary values for testing
...
@@ -15,10 +14,11 @@ NUM_LAYERS = [1] # Arbitrary values for testing
NUM_HEADS
=
[
8
]
# Arbitrary values for testing
NUM_HEADS
=
[
8
]
# Arbitrary values for testing
HEAD_SIZES
=
[
64
,
80
,
96
,
112
,
128
,
256
]
HEAD_SIZES
=
[
64
,
80
,
96
,
112
,
128
,
256
]
BLOCK_SIZES
=
[
8
,
16
,
32
]
BLOCK_SIZES
=
[
8
,
16
,
32
]
# reduce the size for ROCm test to avoid HIP OOM
NUM_BLOCKS
=
[
1024
,
36000
]
if
not
is_hip
else
[
# Arbitrary values for testing
1024
,
10000
# don't make it too large. e.g. [1024, 36000] will OOM
]
# Arbitrary values for testing
NUM_BLOCKS
=
[
1024
,
10000
]
NUM_MAPPINGS
=
[
256
]
# Arbitrary values for testing
NUM_MAPPINGS
=
[
256
]
# Arbitrary values for testing
SEEDS
=
[
0
]
SEEDS
=
[
0
]
CUDA_DEVICES
=
[
CUDA_DEVICES
=
[
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment