llm/ggml.go · d6dd2ff8390884103c1bf15f1c031ec3b352c799 · orangecat / ollama · GitLab

"test/nni_test/nnitest/naive_test.py" did not exist on "19173aa4370e36cba96ee7049eaaa0dceda5007c"

Find file Blame History Permalink

update memory calcualtions · 91b3e4d2
Michael Yang authored Mar 18, 2024
```
count each layer independently when deciding gpu offloading
```
91b3e4d2

ggml.go 5.78 KB