Skip to content

GitLab

Unverified Commit ea6275df authored by fzyzcjy's avatar fzyzcjy Committed by GitHub
Browse files

Tiny add hints when users send requests to wrong place (#11808)

parent eb7318f1
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 0 deletions
python/sglang/srt/managers/data_parallel_controller.py
View file @ ea6275df
...@@ -447,6 +447,9 @@ class DataParallelController: ...@@ -447,6 +447,9 @@ class DataParallelController:
self.workers self.workers
) )
else: else:
assert (
req.bootstrap_room is not None
), "req.bootstrap_room should not be None. Do not send requests directly to prefill or decode instances, but send to the router instead."
self.workers[req.bootstrap_room % len(self.workers)].send_pyobj(req) self.workers[req.bootstrap_room % len(self.workers)].send_pyobj(req)
def shortest_queue_scheduler(self, req): def shortest_queue_scheduler(self, req):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment