Skip to content

GitLab

"git@developer.sourcefind.cn:OpenDAS/dlib.git" did not exist on "286ca71e1a521ef5f24b3956227f1398140188a8"
Unverified Commit 17536e7e authored by Byron Hsu's avatar Byron Hsu Committed by GitHub
Browse files

Fix edge case for truncated (#1747)

parent 1f26e8b8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/managers/scheduler.py
View file @ 17536e7e
...@@ -416,7 +416,7 @@ class Scheduler: ...@@ -416,7 +416,7 @@ class Scheduler:
) )
# Truncate prompts that are too long # Truncate prompts that are too long
if len(req.origin_input_ids) >= self.max_req_input_len: if len(req.origin_input_ids) > self.max_req_input_len:
logger.warning( logger.warning(
"Request length is longer than the KV cache pool size or " "Request length is longer than the KV cache pool size or "
"the max context length. Truncated!!!" "the max context length. Truncated!!!"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment