1. 10 Jul, 2024 1 commit
    • Daniel Hiltgen's avatar
      Bump ROCm on windows to 6.1.2 · 1f50356e
      Daniel Hiltgen authored
      This also adjusts our algorithm to favor our bundled ROCm.
      I've confirmed VRAM reporting still doesn't work properly so we
      can't yet enable concurrency by default.
      1f50356e
  2. 09 Jul, 2024 1 commit
  3. 06 Jul, 2024 4 commits
  4. 05 Jul, 2024 1 commit
  5. 15 Jun, 2024 1 commit
  6. 14 Jun, 2024 1 commit
  7. 04 Jun, 2024 1 commit
  8. 31 May, 2024 1 commit
  9. 30 May, 2024 1 commit
  10. 24 May, 2024 1 commit
  11. 07 May, 2024 2 commits
  12. 26 Apr, 2024 4 commits
  13. 23 Apr, 2024 2 commits
    • Daniel Hiltgen's avatar
      Move nested payloads to installer and zip file on windows · 058f6cd2
      Daniel Hiltgen authored
      Now that the llm runner is an executable and not just a dll, more users are facing
      problems with security policy configurations on windows that prevent users
      writing to directories and then executing binaries from the same location.
      This change removes payloads from the main executable on windows and shifts them
      over to be packaged in the installer and discovered based on the executables location.
      This also adds a new zip file for people who want to "roll their own" installation model.
      058f6cd2
    • Daniel Hiltgen's avatar
      Make CI lint verbvose · 939d6a86
      Daniel Hiltgen authored
      939d6a86
  14. 17 Apr, 2024 5 commits
  15. 10 Apr, 2024 1 commit
  16. 09 Apr, 2024 3 commits
  17. 04 Apr, 2024 3 commits
  18. 03 Apr, 2024 2 commits
  19. 02 Apr, 2024 1 commit
  20. 01 Apr, 2024 2 commits
    • Daniel Hiltgen's avatar
      Switch back to subprocessing for llama.cpp · 58d95cc9
      Daniel Hiltgen authored
      This should resolve a number of memory leak and stability defects by allowing
      us to isolate llama.cpp in a separate process and shutdown when idle, and
      gracefully restart if it has problems.  This also serves as a first step to be
      able to run multiple copies to support multiple models concurrently.
      58d95cc9
    • Michael Yang's avatar
      fix generate output · 1ec0df10
      Michael Yang authored
      1ec0df10
  21. 29 Mar, 2024 1 commit
  22. 28 Mar, 2024 1 commit