[router] ignore client error when record failure in pd_router (#9503)

Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>

[router] ignore client error when record failure in pd_router (#9503)
Co-authored-by: bruce.xu <bruce.xu@gmicloud.ai>
446c8e4c · Bruce-x-1997 · GitHub · 5ef545e6 · 446c8e4c
Unverified Commit 446c8e4c authored Aug 23, 2025 by Bruce-x-1997 Committed by GitHub Aug 22, 2025
Show whitespace changes
Inline Side-by-side

Showing with 4 additions and 3 deletions

sgl-router/src/routers/pd_router.rs sgl-router/src/routers/pd_router.rs +4 -3

No files found.
--- a/sgl-router/src/routers/pd_router.rs
+++ b/sgl-router/src/routers/pd_router.rs
@@ -786,9 +786,10 @@ impl PDRouter {
                            .await;
                        // Record outcomes for circuit breakers
-                        let is_success = response.status().is_success();
+                        let _status = response.status();
-                        prefill.record_outcome(is_success);
+                        let not_error = _status.is_success() || _status.is_client_error();
-                        decode.record_outcome(is_success);
+                        prefill.record_outcome(not_error);
+                        decode.record_outcome(not_error);
                        response
                    }