Skip to content

GitLab

"scripts/convert_ovis_image_to_diffusers.py" did not exist on "784b351f32fad39ad8c8bb238faaa44090e00a08"
Unverified Commit 6ce6eabb authored by Jesse Lopez's avatar Jesse Lopez Committed by GitHub
Browse files

Copy config files for MI300X to support in virtualized environments (#3505)

parent 4e23c961
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 0 deletions
docker/Dockerfile.rocm
View file @ 6ce6eabb
...@@ -58,6 +58,11 @@ RUN git clone ${ATER_REPO} \ ...@@ -58,6 +58,11 @@ RUN git clone ${ATER_REPO} \
&& git submodule update --init --recursive \ && git submodule update --init --recursive \
&& PREBUILD_KERNELS=1 GPU_ARCHS=gfx942 python3 setup.py develop && PREBUILD_KERNELS=1 GPU_ARCHS=gfx942 python3 setup.py develop
# Copy config files to support MI300X in virtualized environments (MI300X_VF). Symlinks will not be created in image build.
RUN find /sgl-workspace/sglang/python/sglang/srt/layers/quantization/configs/ \
/sgl-workspace/sglang/python/sglang/srt/layers/moe/fused_moe_triton/configs/ \
-type f -name '*MI300X*' | xargs -I {} sh -c 'vf_config=$(echo "$1" | sed "s/MI300X/MI300X_VF/"); cp "$1" "$vf_config"' -- {}
# Performance environment variable. # Performance environment variable.
ENV HIP_FORCE_DEV_KERNARG=1 ENV HIP_FORCE_DEV_KERNARG=1
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment