1. 19 Dec, 2023 1 commit
  2. 21 Nov, 2023 1 commit
  3. 24 Oct, 2023 1 commit
  4. 23 Oct, 2023 1 commit
  5. 06 Oct, 2023 1 commit
  6. 21 Sep, 2023 1 commit
  7. 20 Sep, 2023 1 commit
  8. 18 Sep, 2023 1 commit
    • Bruce MacDonald's avatar
      subprocess improvements (#524) · 66003e1d
      Bruce MacDonald authored
      * subprocess improvements
      
      - increase start-up timeout
      - when runner fails to start fail rather than timing out
      - try runners in order rather than choosing 1 runner
      - embed metal runner in metal dir rather than gpu
      - refactor logging and error messages
      
      * Update llama.go
      
      * Update llama.go
      
      * simplify by using glob
      66003e1d
  9. 12 Sep, 2023 1 commit
  10. 07 Sep, 2023 1 commit
  11. 06 Sep, 2023 1 commit
  12. 05 Sep, 2023 2 commits
  13. 30 Aug, 2023 1 commit
    • Bruce MacDonald's avatar
      subprocess llama.cpp server (#401) · 42998d79
      Bruce MacDonald authored
      * remove c code
      * pack llama.cpp
      * use request context for llama_cpp
      * let llama_cpp decide the number of threads to use
      * stop llama runner when app stops
      * remove sample count and duration metrics
      * use go generate to get libraries
      * tmp dir for running llm
      42998d79