• Michael Yang's avatar
    fix: model load for unsupported embedding models (#12311) · 9f3a37fd
    Michael Yang authored
    with #12181, there's now support for embeddings in ollama engine.
    this is done by mutating the architecture and adding _embed when it
    detects an embedding model. however this introduced a bug where if
    an embedding model was run based on an existing ollama engine model
    without an embedding implementation, e.g. llama4, it will pass the
    initial arch support check but fail when actually loaded.
    
    there's currently two entrypoints to creating a model. previously this
    second entrypoint was necessary because calling model.New would also
    load the model. since #11818, this is no longer th case so merge them
    to reduce complexity
    9f3a37fd
model.go 7.67 KB