Skip to content

GitLab

Unverified Commit 9c0c1e30 authored by Qiaolin Yu's avatar Qiaolin Yu Committed by GitHub
Browse files

Disable torch.compile for get_last_loc_large_page_size_large_top_k (#9507) 


Co-authored-by: default avatarispobock <ispobaoke@gmail.com>
parent a1f011d0
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 1 deletion
python/sglang/srt/speculative/eagle_worker.py
View file @ 9c0c1e30
......@@ -1017,7 +1017,9 @@ def get_last_loc_large_page_size_top_k_1(
return prefix_lens, seq_lens, last_loc
@torch.compile(dynamic=True)
# Disable torch.compile for this function because it will be
# even slower.
# @torch.compile(dynamic=True)
def get_last_loc_large_page_size_large_top_k(
req_to_token: torch.Tensor,
req_pool_indices: torch.Tensor,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment