Skip to content

GitLab

Unverified Commit b830afa7 authored by Daniel Hiltgen's avatar Daniel Hiltgen Committed by GitHub
Browse files

Merge pull request #2837 from dhiltgen/podman_image_support 

Add env var so podman will map cuda GPUs
parents bd1d8b0d 794a916a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
Dockerfile
View file @ b830afa7
......@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
ENV PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
ENV LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
ENV NVIDIA_DRIVER_CAPABILITIES=compute,utility
ENV NVIDIA_VISIBLE_DEVICES=all
ENTRYPOINT ["/bin/ollama"]
CMD ["serve"]
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment