GitLab

* Support cuda build in Windows
* Enable dynamic NumGPU allocation for Windows

* add `"format": "json"` as an API parameter
---------
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

add error for falcon and starcoder vocab compatibility
---------
Co-authored-by: Bruce MacDonald <brucewmacdonald@gmail.com>

omitting `--n-gpu-layers` means use metal on macos which isn't correct
since ollama uses `num_gpu=0` to explicitly disable gpu for file types
that are not implemented in metal

- remove new lines from llama.cpp error messages relayed to client
- check api option types and return error on wrong type
- change num layers from 95% VRAM to 92% VRAM

* give direction to user when runner fails
* also relay errors from timeout
* increase timeout to 3 minutes

* prevent waiting on exited command
* close llama runner once

* check free memory not total
* wait for subprocess to exit

- this makes it easier to see that the subprocess is associated with ollama