-
Kay Yan authored
[Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202) Signed-off-by:Kay Yan <kay.yan@daocloud.io>
86fc2321
[Metrics] Add bucket for `request_latency`, `time_to_first_token` and `time_per_output_token` (#15202)
Signed-off-by: Kay Yan <kay.yan@daocloud.io>