Fix all gather torch compile (#3992)

Co-authored-by: yizhang2077 <1109276519@qq.com>

Fix all gather torch compile (#3992)
Co-authored-by: yizhang2077 <1109276519@qq.com>
00ce7e31 · Ke Bao · GitHub · 50f28f65 · 00ce7e31
Unverified Commit 00ce7e31 authored Mar 02, 2025 by Ke Bao Committed by GitHub Mar 02, 2025
Hide whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/srt/distributed/parallel_state.py python/sglang/srt/distributed/parallel_state.py +1 -1

No files found.
--- a/python/sglang/srt/distributed/parallel_state.py
+++ b/python/sglang/srt/distributed/parallel_state.py
@@ -156,7 +156,7 @@ if supports_custom_op():
    direct_register_custom_op(
        op_name="reg_all_gather_into_tensor",
        op_func=reg_all_gather_into_tensor,
-        mutates_args=[],
+        mutates_args=["output"],
        fake_impl=reg_all_gather_into_tensor_fake,
    )