Unverified Commit 4df417d0 authored by zspo's avatar zspo Committed by GitHub
Browse files

fix: fix some args desc (#2487)

parent 5d80a917
......@@ -11,7 +11,6 @@ class Prefix:
prefix caching in the future.
Args:
prefix_id: The id of the prefix in the prefix pool.
token_ids: The token ids of the prefix.
block_size: The block size of the executed model.
"""
......
......@@ -229,6 +229,7 @@ class SequenceGroup:
seqs: The list of sequences.
sampling_params: The sampling parameters used to generate the outputs.
arrival_time: The arrival time of the request.
prefix: The prefix of the prompt of the sequence group.
"""
def __init__(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment