Unverified Commit 446c8e4c authored by Bruce-x-1997's avatar Bruce-x-1997 Committed by GitHub
Browse files

[router] ignore client error when record failure in pd_router (#9503)


Co-authored-by: default avatarbruce.xu <bruce.xu@gmicloud.ai>
parent 5ef545e6
......@@ -786,9 +786,10 @@ impl PDRouter {
.await;
// Record outcomes for circuit breakers
let is_success = response.status().is_success();
prefill.record_outcome(is_success);
decode.record_outcome(is_success);
let _status = response.status();
let not_error = _status.is_success() || _status.is_client_error();
prefill.record_outcome(not_error);
decode.record_outcome(not_error);
response
}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment