- 22 Jul, 2024 1 commit
-
-
Michael Yang authored
-
- 03 Jul, 2024 1 commit
-
-
Daniel Hiltgen authored
This change fixes the handling of keep_alive so that if client request omits the setting, we only set this on initial load. Once the model is loaded, if new requests leave this unset, we'll keep whatever keep_alive was there.
-
- 12 Jun, 2024 1 commit
-
-
Patrick Devine authored
-
- 24 May, 2024 1 commit
-
-
Patrick Devine authored
-
- 23 May, 2024 1 commit
-
-
Jeffrey Morgan authored
* put flash attention behind flag for now * add test * remove print * up timeout for sheduler tests
-
- 10 May, 2024 1 commit
-
-
Daniel Hiltgen authored
-
- 05 May, 2024 1 commit
-
-
Daniel Hiltgen authored
This moves all the env var reading into one central module and logs the loaded config once at startup which should help in troubleshooting user server logs
-