Unverified Commit 38f25e87 authored by penguin_wwy's avatar penguin_wwy Committed by GitHub
Browse files

Correcting default configuration when benchmarking fused_moe (#4665)

parent 8cd42504
......@@ -267,6 +267,7 @@ class BenchmarkWorker:
topk,
dtype_str,
False,
block_shape,
)
else:
config = op_config[min(op_config.keys(), key=lambda x: abs(x - num_tokens))]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment