Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
092475f7
Unverified
Commit
092475f7
authored
Apr 03, 2025
by
Huy Do
Committed by
GitHub
Apr 03, 2025
Browse files
[ROCm] Tweak the benchmark script to run on ROCm (#14252)
parent
dcc56d62
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
21 additions
and
6 deletions
+21
-6
.buildkite/nightly-benchmarks/scripts/run-performance-benchmarks.sh
.../nightly-benchmarks/scripts/run-performance-benchmarks.sh
+21
-6
No files found.
.buildkite/nightly-benchmarks/scripts/run-performance-benchmarks.sh
View file @
092475f7
...
...
@@ -10,15 +10,24 @@ set -x
set
-o
pipefail
check_gpus
()
{
if
command
-v
nvidia-smi
;
then
# check the number of GPUs and GPU type.
declare
-g
gpu_count
=
$(
nvidia-smi
--list-gpus
|
wc
-l
)
elif
command
-v
amd-smi
;
then
declare
-g
gpu_count
=
$(
amd-smi list |
grep
'GPU'
|
wc
-l
)
fi
if
[[
$gpu_count
-gt
0
]]
;
then
echo
"GPU found."
else
echo
"Need at least 1 GPU to run benchmarking."
exit
1
fi
if
command
-v
nvidia-smi
;
then
declare
-g
gpu_type
=
$(
nvidia-smi
--query-gpu
=
name
--format
=
csv,noheader |
awk
'{print $2}'
)
elif
command
-v
amd-smi
;
then
declare
-g
gpu_type
=
$(
amd-smi static
-g
0
-a
|
grep
'MARKET_NAME'
|
awk
'{print $2}'
)
fi
echo
"GPU type is
$gpu_type
"
}
...
...
@@ -90,9 +99,15 @@ kill_gpu_processes() {
# wait until GPU memory usage smaller than 1GB
if
command
-v
nvidia-smi
;
then
while
[
"
$(
nvidia-smi
--query-gpu
=
memory.used
--format
=
csv,noheader,nounits |
head
-n
1
)
"
-ge
1000
]
;
do
sleep
1
done
elif
command
-v
amd-smi
;
then
while
[
"
$(
amd-smi metric
-g
0 |
grep
'USED_VRAM'
|
awk
'{print $2}'
)
"
-ge
1000
]
;
do
sleep
1
done
fi
# remove vllm config file
rm
-rf
~/.config/vllm
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment