Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
5fc4b600
"tests/pytorch/sparse/test_matmul.py" did not exist on "1f2fcae3e29d96696f512b443e087e823e9f42d6"
Unverified
Commit
5fc4b600
authored
Apr 21, 2025
by
fzyzcjy
Committed by
GitHub
Apr 20, 2025
Browse files
Add sanity check for max_running_requests (#5016)
parent
b868526d
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
python/sglang/srt/managers/tp_worker.py
python/sglang/srt/managers/tp_worker.py
+1
-0
No files found.
python/sglang/srt/managers/tp_worker.py
View file @
5fc4b600
...
...
@@ -116,6 +116,7 @@ class TpModelWorker:
),
self
.
model_runner
.
req_to_token_pool
.
size
,
)
assert
self
.
max_running_requests
>
0
,
"max_running_request is zero"
self
.
max_req_len
=
min
(
self
.
model_config
.
context_len
-
1
,
self
.
max_total_num_tokens
-
1
,
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment