Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
tsoc
vllm-auto-test
Commits
49e33ebe
Commit
49e33ebe
authored
Mar 19, 2026
by
liuxu3
Browse files
Update online_quick_check_maxbs.sh
parent
e731206f
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
online_apiserver_test_maxbs/online_quick_check_maxbs.sh
online_apiserver_test_maxbs/online_quick_check_maxbs.sh
+1
-0
No files found.
online_apiserver_test_maxbs/online_quick_check_maxbs.sh
View file @
49e33ebe
...
...
@@ -90,6 +90,7 @@ while read -r item; do
output_throughput
=
`
grep
-a
"^Output token throughput (tok/s):"
${
result_path
}
/
${
model_name
}
-tp-
${
tp
}
-input_len-
${
input_len
}
-output_len-
${
output_len
}
-ttft_thre-
${
ttft_thre
}
-tpot_thre-
${
tpot_thre
}
-bs-
${
bs
}
.log |
awk
-F
' '
'{print $5}'
`
total_throughput
=
`
grep
-a
"^Total Token throughput (tok/s):"
${
result_path
}
/
${
model_name
}
-tp-
${
tp
}
-input_len-
${
input_len
}
-output_len-
${
output_len
}
-ttft_thre-
${
ttft_thre
}
-tpot_thre-
${
tpot_thre
}
-bs-
${
bs
}
.log |
awk
-F
' '
'{print $5}'
`
# vllm 0.15版本的话grep内容需要修改为"^Total token throughput (tok/s):",后续会更新
TTFT_mean
=
`
grep
-a
"^Mean TTFT (ms):"
${
result_path
}
/
${
model_name
}
-tp-
${
tp
}
-input_len-
${
input_len
}
-output_len-
${
output_len
}
-ttft_thre-
${
ttft_thre
}
-tpot_thre-
${
tpot_thre
}
-bs-
${
bs
}
.log |
awk
-F
' '
'{print $4}'
`
TPOT_mean
=
`
grep
-a
"^Mean TPOT (ms):"
${
result_path
}
/
${
model_name
}
-tp-
${
tp
}
-input_len-
${
input_len
}
-output_len-
${
output_len
}
-ttft_thre-
${
ttft_thre
}
-tpot_thre-
${
tpot_thre
}
-bs-
${
bs
}
.log |
awk
-F
' '
'{print $4}'
`
ITL_mean
=
`
grep
-a
"^Mean ITL (ms):"
${
result_path
}
/
${
model_name
}
-tp-
${
tp
}
-input_len-
${
input_len
}
-output_len-
${
output_len
}
-ttft_thre-
${
ttft_thre
}
-tpot_thre-
${
tpot_thre
}
-bs-
${
bs
}
.log |
awk
-F
' '
'{print $4}'
`
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment