engine_args.md 495 Bytes
Newer Older
1
(engine-args)=
2

3
# Engine Arguments
4
5
6

Below, you can find an explanation of every engine argument for vLLM:

7
```{eval-rst}
8
9
10
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
11
    :prog: vllm serve
12
    :nodefaultconst:
13
```
14

15
## Async Engine Arguments
16

17
Below are the additional arguments related to the asynchronous engine:
18

19
```{eval-rst}
20
21
22
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
23
    :prog: vllm serve
24
25
    :nodefaultconst:
```