Skip to content

GitLab

Unverified Commit f094e0a4 authored by Chang Su's avatar Chang Su Committed by GitHub
Browse files

[router][grpc] Fix request_id extraction when n > 1 (#11311)

parent 4ed67c27
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 2 deletions
python/sglang/srt/entrypoints/grpc_request_manager.py
View file @ f094e0a4
...@@ -263,8 +263,8 @@ class GrpcRequestManager: ...@@ -263,8 +263,8 @@ class GrpcRequestManager:
response = await task response = await task
# Add index for client-side ordering # Add index for client-side ordering
if isinstance(response, dict) and "meta_info" in response: if isinstance(response, dict):
response_rid = response["meta_info"].get("id", "") response_rid = response.get("request_id", "")
if response_rid in rid_to_index: if response_rid in rid_to_index:
response["index"] = rid_to_index[response_rid] response["index"] = rid_to_index[response_rid]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment