"vllm/vscode:/vscode.git/clone" did not exist on "255e34ca50db3fc1f0ef8b66193b7c2fe47ca672"
Unverified Commit 788f284b authored by Michael Goin's avatar Michael Goin Committed by GitHub
Browse files

Fix test_block_fp8.py test for MoE (#13915)


Signed-off-by: default avatarmgoin <mgoin64@gmail.com>
parent 4b1d141f
......@@ -30,8 +30,8 @@ M_moe = [1, 7, 83, 512, 2048]
N_moe = [4608] # [128, 4608, 13824]
K_moe = [7168] # [256, 7168, 13824]
BLOCK_SIZE = [[128, 128]]
E = [256] # [8, 24, 128, 256]
TOP_KS = [1] # [1, 2, 6]
E = [8, 24] # [8, 24, 128, 256]
TOP_KS = [2] # [1, 2, 6]
OUT_DTYPES = [torch.bfloat16] # [torch.float32, torch.half, torch.bfloat16]
SEEDS = [0]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment