Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
79ee45b4
Unverified
Commit
79ee45b4
authored
Nov 15, 2024
by
ElizaWszola
Committed by
GitHub
Nov 15, 2024
Browse files
[Misc] Bump up test_fused_moe tolerance (#10364)
Signed-off-by:
ElizaWszola
<
eliza@neuralmagic.com
>
parent
691a3ec0
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
1 deletion
+1
-1
tests/kernels/test_moe.py
tests/kernels/test_moe.py
+1
-1
No files found.
tests/kernels/test_moe.py
View file @
79ee45b4
...
...
@@ -45,7 +45,7 @@ def test_fused_moe(
score
=
torch
.
randn
((
m
,
e
),
device
=
"cuda"
,
dtype
=
dtype
)
triton_output
=
fused_moe
(
a
,
w1
,
w2
,
score
,
topk
,
renormalize
=
False
)
torch_output
=
torch_moe
(
a
,
w1
,
w2
,
score
,
topk
)
torch
.
testing
.
assert_close
(
triton_output
,
torch_output
,
atol
=
1
e-2
,
rtol
=
0
)
torch
.
testing
.
assert_close
(
triton_output
,
torch_output
,
atol
=
2
e-2
,
rtol
=
0
)
@
pytest
.
mark
.
parametrize
(
"dtype"
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment