Skip to content

GitLab

"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "70788bdbdc590e7fbf9bddb3fa9bc92ac3181733"
Unverified Commit 1a27649c authored by jthomson04's avatar jthomson04 Committed by GitHub
Browse files

fix: Fix cublas and cublasLt symlinks in vLLM runtime container (#4421) 


Signed-off-by: default avatarjthomson04 <jwillthomson19@gmail.com>
parent e3cee95f
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
container/Dockerfile.vllm
View file @ 1a27649c
......@@ -217,6 +217,8 @@ COPY --from=framework /usr/local/cuda/bin/fatbinary /usr/local/cuda/bin/fatbinar
COPY --from=framework /usr/local/cuda/include/ /usr/local/cuda/include/
COPY --from=framework /usr/local/cuda/nvvm /usr/local/cuda/nvvm
COPY --from=framework /usr/local/cuda/lib64/libcudart.so* /usr/local/cuda/lib64/
COPY --from=framework /usr/local/cuda/lib64/libcublas.so* /usr/local/cuda/lib64/
COPY --from=framework /usr/local/cuda/lib64/libcublasLt.so* /usr/local/cuda/lib64/
### COPY NATS & ETCD ###
# Copy nats and etcd from dev image
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment