Skip to content

GitLab

Unverified Commit e8953558 authored by Alec's avatar Alec Committed by GitHub
Browse files

fix: increase gpu-memory-utilization to 0.95 for dsr1_dep (#5144) 


Signed-off-by: default avataralec-flowers <aflowers@nvidia.com>
parent cdeda221
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
examples/backends/vllm/launch/dsr1_dep.sh
View file @ e8953558
...@@ -107,7 +107,7 @@ for ((i=0; i<GPUS_PER_NODE; i++)); do ...@@ -107,7 +107,7 @@ for ((i=0; i<GPUS_PER_NODE; i++)); do
--max-model-len 4096 \ --max-model-len 4096 \
--data-parallel-address $MASTER_ADDR \ --data-parallel-address $MASTER_ADDR \
--data-parallel-rpc-port 13345 \ --data-parallel-rpc-port 13345 \
--gpu-memory-utilization 0.9 \ --gpu-memory-utilization 0.95 \
--enforce-eager 2>&1 | tee $LOG_DIR/dsr1_dep_${dp_rank}.log & --enforce-eager 2>&1 | tee $LOG_DIR/dsr1_dep_${dp_rank}.log &
done done
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment