Skip to content

GitLab

Switch branch/tag
Find file BlameHistoryPermalink
  • Daniel Hiltgen's avatar
    Introduce GPU Overhead env var (#5922) · b05c9e83
    Daniel Hiltgen authored 
    Provide a mechanism for users to set aside an amount of VRAM on each GPU
to make room for other applications they want to start after Ollama, or workaround
memory prediction bugs
    b05c9e83
cmd.go 33.2 KB