Skip to content

GitLab

Switch branch/tag
  1. 05 Sep, 2023 2 commits
  3. 30 Aug, 2023 1 commit
    • Bruce MacDonald's avatar
      subprocess llama.cpp server (#401) · 42998d79
      Bruce MacDonald authored 
      * remove c code
* pack llama.cpp
* use request context for llama_cpp
* let llama_cpp decide the number of threads to use
* stop llama runner when app stops
* remove sample count and duration metrics
* use go generate to get libraries
* tmp dir for running llm
      42998d79
  5. 26 Aug, 2023 1 commit
  7. 25 Aug, 2023 1 commit
  9. 14 Aug, 2023 1 commit
  11. 13 Aug, 2023 1 commit
  13. 10 Aug, 2023 1 commit
  15. 03 Aug, 2023 1 commit
  17. 01 Aug, 2023 1 commit
  19. 28 Jul, 2023 1 commit
  21. 27 Jul, 2023 1 commit
  23. 20 Jul, 2023 1 commit
  25. 11 Jul, 2023 1 commit