GitLab

* envconfig: allow setting context length through env var

The route assembly in Handler lacked clear organization making it
difficult scan for routes and their relationships to each other. This
commit aims to fix that by reordering the assembly of routes to group
them by category and purpose.

Also, be more specific about what "config" refers to (it is about CORS
if you were wondering... I was.)

With the new very large parameter models, some users are willing to wait for
a very long time for models to load.

This change fixes the handling of keep_alive so that if client
request omits the setting, we only set this on initial load.  Once
the model is loaded, if new requests leave this unset, we'll keep
whatever keep_alive was there.

* put flash attention behind flag for now

* add test

* remove print

* up timeout for sheduler tests

This moves all the env var reading into one central module
and logs the loaded config once at startup which should
help in troubleshooting user server logs