Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
e98def43
Unverified
Commit
e98def43
authored
Jul 26, 2025
by
Huy Do
Committed by
GitHub
Jul 26, 2025
Browse files
[Take 2] Correctly kill vLLM processes after benchmarks (#21646)
Signed-off-by:
Huy Do
<
huydhn@gmail.com
>
parent
05c1126f
Changes
3
Show whitespace changes
Inline
Side-by-side
Showing
3 changed files
with
6 additions
and
1 deletion
+6
-1
.buildkite/nightly-benchmarks/scripts/run-performance-benchmarks.sh
.../nightly-benchmarks/scripts/run-performance-benchmarks.sh
+2
-1
benchmarks/disagg_benchmarks/disagg_overhead_benchmark.sh
benchmarks/disagg_benchmarks/disagg_overhead_benchmark.sh
+2
-0
benchmarks/disagg_benchmarks/disagg_performance_benchmark.sh
benchmarks/disagg_benchmarks/disagg_performance_benchmark.sh
+2
-0
No files found.
.buildkite/nightly-benchmarks/scripts/run-performance-benchmarks.sh
View file @
e98def43
...
@@ -126,7 +126,8 @@ kill_gpu_processes() {
...
@@ -126,7 +126,8 @@ kill_gpu_processes() {
ps
-aux
ps
-aux
lsof
-t
-i
:8000 | xargs
-r
kill
-9
lsof
-t
-i
:8000 | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
# vLLM now names the process with VLLM prefix after https://github.com/vllm-project/vllm/pull/21445
pgrep VLLM | xargs
-r
kill
-9
# wait until GPU memory usage smaller than 1GB
# wait until GPU memory usage smaller than 1GB
if
command
-v
nvidia-smi
;
then
if
command
-v
nvidia-smi
;
then
...
...
benchmarks/disagg_benchmarks/disagg_overhead_benchmark.sh
View file @
e98def43
...
@@ -12,6 +12,8 @@ kill_gpu_processes() {
...
@@ -12,6 +12,8 @@ kill_gpu_processes() {
# kill all processes on GPU.
# kill all processes on GPU.
pgrep pt_main_thread | xargs
-r
kill
-9
pgrep pt_main_thread | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
# vLLM now names the process with VLLM prefix after https://github.com/vllm-project/vllm/pull/21445
pgrep VLLM | xargs
-r
kill
-9
sleep
10
sleep
10
# remove vllm config file
# remove vllm config file
...
...
benchmarks/disagg_benchmarks/disagg_performance_benchmark.sh
View file @
e98def43
...
@@ -18,6 +18,8 @@ kill_gpu_processes() {
...
@@ -18,6 +18,8 @@ kill_gpu_processes() {
# kill all processes on GPU.
# kill all processes on GPU.
pgrep pt_main_thread | xargs
-r
kill
-9
pgrep pt_main_thread | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
pgrep python3 | xargs
-r
kill
-9
# vLLM now names the process with VLLM prefix after https://github.com/vllm-project/vllm/pull/21445
pgrep VLLM | xargs
-r
kill
-9
for
port
in
8000 8100 8200
;
do
lsof
-t
-i
:
$port
| xargs
-r
kill
-9
;
done
for
port
in
8000 8100 8200
;
do
lsof
-t
-i
:
$port
| xargs
-r
kill
-9
;
done
sleep
1
sleep
1
}
}
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment