Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
abd7df2f
Unverified
Commit
abd7df2f
authored
Jun 03, 2025
by
Jiaxin Shan
Committed by
GitHub
Jun 03, 2025
Browse files
[Misc] Fix path and python alias errors in disagg_prefill exmaples (#18919)
parent
b712be98
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
examples/others/lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
.../lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
+3
-3
No files found.
examples/others/lmcache/disagg_prefill_lmcache_v1/disagg_example_nixl.sh
View file @
abd7df2f
...
...
@@ -33,7 +33,7 @@ check_num_gpus() {
ensure_python_library_installed
()
{
echo
"Checking if
$1
is installed..."
python
-c
"import
$1
"
>
/dev/null 2>&1
python
3
-c
"import
$1
"
>
/dev/null 2>&1
if
[
$?
-ne
0
]
;
then
if
[
"
$1
"
==
"nixl"
]
;
then
echo
"
$1
is not installed. Please refer to https://github.com/ai-dynamo/nixl for installation."
...
...
@@ -121,8 +121,8 @@ main() {
echo
"All servers are up. Starting benchmark..."
# begin benchmark
cd
../../../benchmarks/
python benchmark_serving.py
--port
9000
--seed
$(
date
+%s
)
\
cd
../../../
../
benchmarks/
python
3
benchmark_serving.py
--port
9000
--seed
$(
date
+%s
)
\
--model
meta-llama/Llama-3.1-8B-Instruct
\
--dataset-name
random
--random-input-len
7500
--random-output-len
200
\
--num-prompts
200
--burstiness
100
--request-rate
3.6 |
tee
benchmark.log
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment