"vscode:/vscode.git/clone" did not exist on "3316bdc787f1f7ee78ab727fd065fc34b4123cd2"
  • Daniel Hiltgen's avatar
    Switch back to subprocessing for llama.cpp · 58d95cc9
    Daniel Hiltgen authored
    This should resolve a number of memory leak and stability defects by allowing
    us to isolate llama.cpp in a separate process and shutdown when idle, and
    gracefully restart if it has problems.  This also serves as a first step to be
    able to run multiple copies to support multiple models concurrently.
    58d95cc9
server.cpp 125 KB