engine_args.md 607 Bytes
Newer Older
1
(engine-args)=
2

3
# Engine Arguments
4
5
6

Below, you can find an explanation of every engine argument for vLLM:

7
<!--- pyml disable-num-lines 7 no-space-in-emphasis -->
8
```{eval-rst}
9
10
11
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
12
    :prog: vllm serve
13
    :nodefaultconst:
14
```
15

16
## Async Engine Arguments
17

18
Below are the additional arguments related to the asynchronous engine:
19

20
<!--- pyml disable-num-lines 7 no-space-in-emphasis -->
21
```{eval-rst}
22
23
24
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
25
    :prog: vllm serve
26
27
    :nodefaultconst:
```