Skip to content

GitLab

Unverified Commit 0639bf15 authored by HAI's avatar HAI Committed by GitHub
Browse files

ROCm Container: set SGLANG_SET_CPU_AFFINITY=1 (#2328)

parent aa47f642
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
docker/Dockerfile.rocm
View file @ 0639bf15
......@@ -33,6 +33,7 @@ RUN python -m pip cache purge
# Performance environment variable.
ENV HIP_FORCE_DEV_KERNARG=1
ENV SGLANG_SET_CPU_AFFINITY=1
ENV SGLANG_ALLOW_OVERWRITE_LONGER_CONTEXT_LEN=1
ENV NCCL_MIN_NCHANNELS=112
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment