• Jesse Gross's avatar
    llm: Enable new memory estimates by default · eb10390d
    Jesse Gross authored
    New memory estimates (see #11090 for more information) are now
    enabled automatically for all models running on the Ollama engine,
    improving both stability and performance through more accurate sizing
    and allocation. Models running on the llama engine will continue to
    use the original style of memory estimation.
    eb10390d
config.go 10.7 KB