README.md 335 Bytes
Newer Older
1
2
# Configuration Options

3
4
5
6
7
8
9
This section lists the most common options for running vLLM.

There are three main levels of configuration, from highest priority to lowest priority:

- [Request parameters][completions-api] and [input arguments][sampling-params]
- [Engine arguments](./engine_args.md)
- [Environment variables](./env_vars.md)