Skip to content

GitLab

Unverified Commit 6a290034 authored by Liangsheng Yin's avatar Liangsheng Yin Committed by GitHub
Browse files

Remove unused pack `.item()` in paged allocator. (#11156)

parent 2ac453b0
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 6 deletions
python/sglang/srt/utils.py
View file @ 6a290034
...@@ -3265,13 +3265,8 @@ def get_num_new_pages( ...@@ -3265,13 +3265,8 @@ def get_num_new_pages(
num_pages_after = (seq_lens + page_size - 1) // page_size num_pages_after = (seq_lens + page_size - 1) // page_size
num_pages_before = (prefix_lens + page_size - 1) // page_size num_pages_before = (prefix_lens + page_size - 1) // page_size
num_new_pages = num_pages_after - num_pages_before num_new_pages = num_pages_after - num_pages_before
extend_lens = seq_lens - prefix_lens
sum_num_new_pages = torch.sum(num_new_pages).to(torch.int64) sum_num_new_pages = torch.sum(num_new_pages).to(torch.int64)
if decode:
return sum_num_new_pages.item() return sum_num_new_pages.item()
merged_value = (sum_num_new_pages) << 32 | torch.sum(extend_lens).to(torch.int64)
return merged_value.item() >> 32
class CachedKernel: class CachedKernel:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment