• Jesse Gross's avatar
    ollamarunner: Pass runner performance parameters to backends · bd6a7d5e
    Jesse Gross authored
    Currently the following parameters are in the runner but not used:
     - numGPULayers
     - mainGPU
     - threads
     - tensorSplit
    
    This passes them through to the backend, which is where they would
    actually get used. However, the GGML backend does not yet do anything
    with them.
    bd6a7d5e
model.go 5.3 KB