Skip to content

GitLab

Commit af16c050 authored by Woosuk Kwon's avatar Woosuk Kwon
Browse files

Add get_len

parent d0945122
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
cacheflow/sequence.py
View file @ af16c050
...@@ -49,6 +49,9 @@ class Sequence: ...@@ -49,6 +49,9 @@ class Sequence:
last_block.append(token_ids[:num_empty_slots]) last_block.append(token_ids[:num_empty_slots])
token_ids = token_ids[num_empty_slots:] token_ids = token_ids[num_empty_slots:]
def get_len(self) -> int:
return sum(block.num_tokens for block in self.logical_token_blocks)
def get_token_ids(self) -> List[int]: def get_token_ids(self) -> List[int]:
token_ids: List[int] = [] token_ids: List[int] = []
for block in self.logical_token_blocks: for block in self.logical_token_blocks:
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment