• Bruce MacDonald's avatar
    model: support for mistral-small in the ollama runner · 6bd0a983
    Bruce MacDonald authored
    Mistral is a popular research lab making open source models. This updates
    the forward pass of llama architecture models to support both llama models
    and mistral models by accounting for additional metadata present in mistral
    models, and finding the correct dimensions for the output projection.
    6bd0a983
llama-arch.cpp 86.6 KB