Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
OpenDAS
ollama
Commits
794a916a
Commit
794a916a
authored
Feb 29, 2024
by
Daniel Hiltgen
Browse files
Add env var so podman will map cuda GPUs
Without this env var, podman's GPU logic doesn't map the GPU through
parent
076237b8
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
1 addition
and
0 deletions
+1
-0
Dockerfile
Dockerfile
+1
-0
No files found.
Dockerfile
View file @
794a916a
...
...
@@ -132,6 +132,7 @@ ENV OLLAMA_HOST 0.0.0.0
ENV
PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
ENV
LD_LIBRARY_PATH=/usr/local/nvidia/lib:/usr/local/nvidia/lib64
ENV
NVIDIA_DRIVER_CAPABILITIES=compute,utility
ENV
NVIDIA_VISIBLE_DEVICES=all
ENTRYPOINT
["/bin/ollama"]
CMD
["serve"]
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment