Skip to content

GitLab

Commit a2ffdd60 authored by shangxl's avatar shangxl
Browse files

forward_batch_info.py 增加环境变量

parent e4e2b478
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
python/sglang/srt/model_executor/forward_batch_info.py
View file @ a2ffdd60
...@@ -317,6 +317,8 @@ class ForwardBatch: ...@@ -317,6 +317,8 @@ class ForwardBatch:
tbo_parent_token_range: Optional[Tuple[int, int]] = None tbo_parent_token_range: Optional[Tuple[int, int]] = None
tbo_children: Optional[List[ForwardBatch]] = None tbo_children: Optional[List[ForwardBatch]] = None
use_sglang_create_chunked_prefix_cache_kv_indices = get_bool_env_var("SGLANG_CREATE_CHUNKED_PREFIX_CACHE_KV_INDICES")
@classmethod @classmethod
def init_new( def init_new(
cls, cls,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment