Skip to content

GitLab

Unverified Commit 79ee45b4 authored by ElizaWszola's avatar ElizaWszola Committed by GitHub
Browse files

[Misc] Bump up test_fused_moe tolerance (#10364) 


Signed-off-by: default avatarElizaWszola <eliza@neuralmagic.com>
parent 691a3ec0
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
tests/kernels/test_moe.py
View file @ 79ee45b4
...@@ -45,7 +45,7 @@ def test_fused_moe( ...@@ -45,7 +45,7 @@ def test_fused_moe(
score = torch.randn((m, e), device="cuda", dtype=dtype) score = torch.randn((m, e), device="cuda", dtype=dtype)
triton_output = fused_moe(a, w1, w2, score, topk, renormalize=False) triton_output = fused_moe(a, w1, w2, score, topk, renormalize=False)
torch_output = torch_moe(a, w1, w2, score, topk) torch_output = torch_moe(a, w1, w2, score, topk)
torch.testing.assert_close(triton_output, torch_output, atol=1e-2, rtol=0) torch.testing.assert_close(triton_output, torch_output, atol=2e-2, rtol=0)
@pytest.mark.parametrize("dtype", @pytest.mark.parametrize("dtype",
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment