Reintroduce tiny fix sampler error when prob is not contiguous (#7354)

650127a1 · fzyzcjy · GitHub · 3774f078 · 650127a1
Unverified Commit 650127a1 authored Jun 20, 2025 by fzyzcjy Committed by GitHub Jun 19, 2025
Show whitespace changes
Inline Side-by-side

Showing with 1 addition and 1 deletion

python/sglang/srt/layers/sampler.py python/sglang/srt/layers/sampler.py +1 -1

No files found.
--- a/python/sglang/srt/layers/sampler.py
+++ b/python/sglang/srt/layers/sampler.py
@@ -91,7 +91,7 @@ class Sampler(nn.Module):
                        )
                    else:
                        batch_next_token_ids = top_k_top_p_sampling_from_probs(
-                            probs,
+                            probs.contiguous(),
                            sampling_info.top_ks,
                            sampling_info.top_ps,
                            filter_apply_order="joint",