gpu/gpu_info_darwin.h · a189810df6c4b0492463d1ddb68993c9abc32c7f · OpenDAS / ollama

Determine max VRAM on macOS using `recommendedMaxWorkingSetSize` (#2354) · a189810d

peanut256 authored Feb 26, 2024

* read iogpu.wired_limit_mb on macOS

Fix for https://github.com/ollama/ollama/issues/1826

* improved determination of available vram on macOS

read the recommended maximal vram on macOS via Metal API

* Removed macOS-specific logging

* Remove logging from gpu_darwin.go

* release Core Foundation object

fixes a possible memory leak

a189810d

gpu_info_darwin.h 78 Bytes

Replace gpu_info_darwin.h