Skip to content

GitLab

Unverified Commit 2acba47d authored by Divakar Verma's avatar Divakar Verma Committed by GitHub
Browse files

[bugfix] moe tuning. rm is_navi() (#12273) 


Signed-off-by: default avatarDivakar Verma <divakar.verma@amd.com>
parent 9c485d9e
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
benchmarks/kernels/benchmark_moe.py
View file @ 2acba47d
......@@ -12,10 +12,10 @@ from transformers import AutoConfig
from vllm.model_executor.layers.fused_moe.fused_moe import *
from vllm.platforms import current_platform
from vllm.utils import FlexibleArgumentParser, is_navi
from vllm.utils import FlexibleArgumentParser
FP8_DTYPE = torch.float8_e4m3fnuz if current_platform.is_rocm(
) and not is_navi() else torch.float8_e4m3fn
) else torch.float8_e4m3fn
class BenchmarkConfig(TypedDict):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment