- 20 Feb, 2024 1 commit
-
-
Jeffrey Morgan authored
-
- 19 Feb, 2024 1 commit
-
-
Daniel Hiltgen authored
This should resolve the problem where we don't fully unload from the GPU when we go idle.
-
- 12 Feb, 2024 1 commit
-
-
Jeffrey Morgan authored
-
- 06 Feb, 2024 1 commit
-
-
Daniel Hiltgen authored
-
- 31 Jan, 2024 1 commit
-
-
Daniel Hiltgen authored
This requires an upstream change to support graceful termination, carried as a patch.
-
- 25 Jan, 2024 1 commit
-
-
Jeffrey Morgan authored
* Fix clearing kv cache between requests with the same prompt * fix powershell script
-
