Skip to content

GitLab

Commit 794a916a authored by Daniel Hiltgen's avatar Daniel Hiltgen
Browse files

Add env var so podman will map cuda GPUs 

Without this env var, podman's GPU logic doesn't map the GPU through
parent 076237b8
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
Dockerfile
View file @ 794a916a
...@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0 ...@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64 ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
ENV NVIDIA_VISIBLE_DEVICES=all
ENTRYPOINT ["/bin/ollama"] ENTRYPOINT ["/bin/ollama"]
CMD ["serve"] CMD ["serve"]
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment