engine_args.rst 495 Bytes
Newer Older
1
2
3
4
5
6
7
.. _engine_args:

Engine Arguments
================

Below, you can find an explanation of every engine argument for vLLM:

8
9
10
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
11
    :prog: vllm serve
12
    :nodefaultconst:
13
14
15
16

Async Engine Arguments
----------------------

17
Below are the additional arguments related to the asynchronous engine:
18

19
20
21
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
22
    :prog: vllm serve
23
    :nodefaultconst: