GitLab

This focuses on Windows first, but coudl be used for Mac
and possibly linux in the future.

Run the server.cpp directly inside the Go runtime via cgo
while retaining the LLM Go abstractions.

* Support cuda build in Windows
* Enable dynamic NumGPU allocation for Windows

* remove c code
* pack llama.cpp
* use request context for llama_cpp
* let llama_cpp decide the number of threads to use
* stop llama runner when app stops
* remove sample count and duration metrics
* use go generate to get libraries
* tmp dir for running llm