GitLab

Ubuntu distros fail to install cuda drivers since aarch64 isn't valid

fix modelfile message quotes

patches: phi3 optional sliding window attention

include modelfile messages

fix: environ lookup

Firebase Genkit

Better example for multi-modal input

* add prompt tokens to embed response

* rm slog

* metrics

* types

* prompt n

* clean up

* reset submodule

* update tests

* test name

* list metrics

Prevent partial loading on mixed GPU brands

In mult-brand GPU setups, if we couldn't fully load the model we
would fall through the scheduler and mistakenly try to load across
a mix of brands.  This makes sure we find the set of GPU(s) that
best fit for the partial load.

* Update example models

* Remove unused README.md

Better explain multi-gpu behavior

Ensure amd gpu nodes are numerically sorted

Report better error on cuda unsupported os/arch

* hot fix

* backend stream support

* clean up

* finish reason

* move to openai

Explain font problems on windows 10

HuggingFace -> Hugging Face

fix: model save

Enable windows error dialog for subprocess

fix nil deref in auth.go

This fixes various data races scattered throughout the download/pull
client where the client was accessing the download state concurrently.

This commit is mostly a hot-fix and will be replaced by a new client one
day soon.

Also, remove the unnecessary opts argument from downloadChunk.

autodetect stop parameters from template

stop parameter is saved as a slice which is incompatible with modelfile
parsing