1. 19 Jun, 2024 1 commit
  2. 17 Jun, 2024 1 commit
  3. 14 Jun, 2024 2 commits
    • Daniel Hiltgen's avatar
      Centralize GPU configuration vars · 6be309e1
      Daniel Hiltgen authored
      This should aid in troubleshooting by capturing and reporting the GPU
      settings at startup in the logs along with all the other server settings.
      6be309e1
    • Daniel Hiltgen's avatar
      Support forced spreading for multi GPU · 5e8ff556
      Daniel Hiltgen authored
      Our default behavior today is to try to fit into a single GPU if possible.
      Some users would prefer the old behavior of always spreading across
      multiple GPUs even if the model can fit into one.  This exposes that
      tunable behavior.
      5e8ff556
  4. 13 Jun, 2024 1 commit
  5. 12 Jun, 2024 1 commit
  6. 06 Jun, 2024 1 commit
  7. 04 Jun, 2024 2 commits
  8. 30 May, 2024 1 commit
  9. 24 May, 2024 1 commit
  10. 23 May, 2024 1 commit
  11. 05 May, 2024 1 commit
    • Daniel Hiltgen's avatar
      Centralize server config handling · f56aa200
      Daniel Hiltgen authored
      This moves all the env var reading into one central module
      and logs the loaded config once at startup which should
      help in troubleshooting user server logs
      f56aa200