1. 22 Jul, 2024 1 commit
  2. 19 Jun, 2024 1 commit
  3. 04 Jun, 2024 2 commits
  4. 24 May, 2024 1 commit
  5. 12 May, 2024 2 commits
  6. 05 May, 2024 1 commit
    • Daniel Hiltgen's avatar
      Centralize server config handling · f56aa200
      Daniel Hiltgen authored
      This moves all the env var reading into one central module
      and logs the loaded config once at startup which should
      help in troubleshooting user server logs
      f56aa200
  7. 29 Apr, 2024 1 commit
  8. 14 Apr, 2024 1 commit
  9. 01 Apr, 2024 1 commit
    • Daniel Hiltgen's avatar
      Switch back to subprocessing for llama.cpp · 58d95cc9
      Daniel Hiltgen authored
      This should resolve a number of memory leak and stability defects by allowing
      us to isolate llama.cpp in a separate process and shutdown when idle, and
      gracefully restart if it has problems.  This also serves as a first step to be
      able to run multiple copies to support multiple models concurrently.
      58d95cc9
  10. 26 Mar, 2024 1 commit
  11. 27 Feb, 2024 1 commit
  12. 20 Feb, 2024 1 commit
  13. 16 Feb, 2024 2 commits
  14. 15 Feb, 2024 5 commits