1. 30 Aug, 2023 1 commit
    • Bruce MacDonald's avatar
      subprocess llama.cpp server (#401) · 42998d79
      Bruce MacDonald authored
      * remove c code
      * pack llama.cpp
      * use request context for llama_cpp
      * let llama_cpp decide the number of threads to use
      * stop llama runner when app stops
      * remove sample count and duration metrics
      * use go generate to get libraries
      * tmp dir for running llm
      42998d79
  2. 25 Aug, 2023 1 commit
  3. 08 Aug, 2023 1 commit
  4. 24 Jul, 2023 1 commit
  5. 21 Jul, 2023 1 commit
  6. 18 Jul, 2023 1 commit
  7. 07 Jul, 2023 1 commit
  8. 28 Jun, 2023 4 commits
  9. 27 Jun, 2023 6 commits