"git@developer.sourcefind.cn:zhaoyu6/sglang.git" did not exist on "b6cf3532b504081ea1d5b52244c0e889b7544856"
fix: stream accumulator exits early (#10593)
the stream accumulator exits as soon as it sees `api.ProgressResponse(status="success")` which isn't strictly correctly since some requests may have multiple successes, e.g. `/api/create` when the source model needs to be pulled.
Showing
Please register or sign in to comment