Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
dynamo
Commits
29f5b822
"lib/vscode:/vscode.git/clone" did not exist on "8a04d7b25224006643259f41d2a480248a384462"
Unverified
Commit
29f5b822
authored
Oct 15, 2025
by
Kris Hung
Committed by
GitHub
Oct 15, 2025
Browse files
fix: Reduce memory usage to avoid vLLM dsr1 OOM (#3660)
parent
43d687e8
Changes
1
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
2 additions
and
2 deletions
+2
-2
components/backends/vllm/launch/dsr1_dep.sh
components/backends/vllm/launch/dsr1_dep.sh
+2
-2
No files found.
components/backends/vllm/launch/dsr1_dep.sh
View file @
29f5b822
...
...
@@ -101,10 +101,10 @@ for ((i=0; i<GPUS_PER_NODE; i++)); do
--data_parallel_size
$DATA_PARALLEL_SIZE
\
--data-parallel-rank
$dp_rank
\
--enable-expert-parallel
\
--max-model-len
102
40
\
--max-model-len
40
96
\
--data-parallel-address
$MASTER_ADDR
\
--data-parallel-rpc-port
13345
\
--gpu-memory-utilization
0.9
5
\
--gpu-memory-utilization
0.9
\
--enforce-eager
2>&1 |
tee
$LOG_DIR
/dsr1_dep_
${
dp_rank
}
.log &
done
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment