GitLab

change to a flatter directory structure and group the options with the
function

update models to call rope in one place

* use slice/chunks

* bert

* llama4

* gemma3n

* gptoss

* mistral3

* qwen3vl

* qwen25vl

* deepseek2

* remove unused ops

Co-authored-by: Michael Yang <git@mxy.ng>

* fix(llama): rope scale

* spm llama

* skip moe models

* cleanup

* use ggml_*_split activations when possible

* forward qkv

this cleans up the model interface slightly without too much impact in
other areas

* Enable CUDA Graphs for gemma3n.

Similar to
https://github.com/ggml-org/llama.cpp/pull/14741,
though ollama has a slightly different model graph
than llama.cpp which requires different workaround
checks.

* Remove residual check by reshaping differently in gemma3n model

This should make the heuristics more robust

* update patches

* cherry pick metal mean kernel

* cherry pick cuda mean kernel

* gemma3n