"tests/entrypoints/openai/test_disable_mp.py" did not exist on "5ae5ed1e6047d4095149e26526a618be0529a118"
Unverified Commit 04a55612 authored by Jee Jee Li's avatar Jee Jee Li Committed by GitHub
Browse files

[Misc] Fix misleading ROCm warning (#19486)


Signed-off-by: default avatarJee Jee Li <pandaleefree@gmail.com>
parent 89b0f84e
......@@ -25,9 +25,14 @@ Not currently supported:
import torch
from vllm.platforms import current_platform
from vllm.platforms.rocm import on_gfx1x
from vllm.triton_utils import tl, triton
# Avoid misleading ROCm warning.
if current_platform.is_rocm():
from vllm.platforms.rocm import on_gfx1x
else:
on_gfx1x = lambda *args, **kwargs: False
torch_dtype: tl.constexpr = torch.float16
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment