Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b4b9813b
Unverified
Commit
b4b9813b
authored
Aug 06, 2025
by
Zhang Jason
Committed by
GitHub
Aug 06, 2025
Browse files
add the codes to check AMD Instinct GPU number (#22367)
Signed-off-by:
Zhang Jason
<
ning.zhang2@amd.com
>
parent
2cb6ef89
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
8 additions
and
2 deletions
+8
-2
examples/others/lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
.../lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
+8
-2
No files found.
examples/others/lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
View file @
b4b9813b
...
...
@@ -21,8 +21,14 @@ check_hf_token() {
}
check_num_gpus
()
{
# can you check if the number of GPUs are >=2 via nvidia-smi?
num_gpus
=
$(
nvidia-smi
--query-gpu
=
name
--format
=
csv,noheader |
wc
-l
)
# can you check if the number of GPUs are >=2 via nvidia-smi/rocm-smi?
which rocm-smi
>
/dev/null 2>&1
if
[
$?
-ne
0
]
;
then
num_gpus
=
$(
nvidia-smi
--query-gpu
=
name
--format
=
csv,noheader |
wc
-l
)
else
num_gpus
=
$(
rocm-smi
--showid
|
grep
Instinct |
wc
-l
)
fi
if
[
"
$num_gpus
"
-lt
2
]
;
then
echo
"You need at least 2 GPUs to run disaggregated prefill."
exit
1
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment