Skip to content

GitLab

Commit 9bea40bd authored by Joseph Young's avatar Joseph Young
Browse files

Adding the missing env variable 

ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"
parent 9a8a48b8
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
Dockerfile-cuda
View file @ 9bea40bd
...@@ -32,6 +32,7 @@ RUN npm run build ...@@ -32,6 +32,7 @@ RUN npm run build
######## CUDA WebUI backend ######## ######## CUDA WebUI backend ########
FROM --platform=linux/amd64 nvidia/cuda:"$CUDA_VERSION"-devel-ubuntu22.04 AS cuda-build-amd64 FROM --platform=linux/amd64 nvidia/cuda:"$CUDA_VERSION"-devel-ubuntu22.04 AS cuda-build-amd64
#FROM --platform=linux/amd64 cgr.dev/chainguard/pytorch-cuda12:latest AS cuda-build-amd64 # fails with python requirements conflicts #FROM --platform=linux/amd64 cgr.dev/chainguard/pytorch-cuda12:latest AS cuda-build-amd64 # fails with python requirements conflicts
ENV RAG_EMBEDDING_MODEL_DEVICE_TYPE="cuda"
# Set environment variables for NVIDIA Container Toolkit # Set environment variables for NVIDIA Container Toolkit
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 \ ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 \
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment