Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
ea4adedd
Unverified
Commit
ea4adedd
authored
Nov 04, 2024
by
Tran Quang Dai
Committed by
GitHub
Nov 04, 2024
Browse files
[Bugfix] Fix E2EL mean and median stats (#9984)
Signed-off-by:
daitran2k1
<
tranquangdai7a@gmail.com
>
parent
4dbcbbeb
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
benchmarks/benchmark_serving.py
benchmarks/benchmark_serving.py
+2
-2
No files found.
benchmarks/benchmark_serving.py
View file @
ea4adedd
...
@@ -406,9 +406,9 @@ def calculate_metrics(
...
@@ -406,9 +406,9 @@ def calculate_metrics(
median_itl_ms
=
np
.
median
(
itls
or
0
)
*
1000
,
median_itl_ms
=
np
.
median
(
itls
or
0
)
*
1000
,
percentiles_itl_ms
=
[(
p
,
np
.
percentile
(
itls
or
0
,
p
)
*
1000
)
percentiles_itl_ms
=
[(
p
,
np
.
percentile
(
itls
or
0
,
p
)
*
1000
)
for
p
in
selected_percentiles
],
for
p
in
selected_percentiles
],
mean_e2el_ms
=
np
.
me
di
an
(
e2els
or
0
)
*
1000
,
mean_e2el_ms
=
np
.
mean
(
e2els
or
0
)
*
1000
,
std_e2el_ms
=
np
.
std
(
e2els
or
0
)
*
1000
,
std_e2el_ms
=
np
.
std
(
e2els
or
0
)
*
1000
,
median_e2el_ms
=
np
.
mean
(
e2els
or
0
)
*
1000
,
median_e2el_ms
=
np
.
me
di
an
(
e2els
or
0
)
*
1000
,
percentiles_e2el_ms
=
[(
p
,
np
.
percentile
(
e2els
or
0
,
p
)
*
1000
)
percentiles_e2el_ms
=
[(
p
,
np
.
percentile
(
e2els
or
0
,
p
)
*
1000
)
for
p
in
selected_percentiles
],
for
p
in
selected_percentiles
],
)
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment