engine_args.rst 549 Bytes
Newer Older
1
2
3
4
5
6
7
.. _engine_args:

Engine Arguments
================

Below, you can find an explanation of every engine argument for vLLM:

8
9
10
11
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
    :prog: -m vllm.entrypoints.openai.api_server
12
    :nodefaultconst:
13
14
15
16

Async Engine Arguments
----------------------

17
Below are the additional arguments related to the asynchronous engine:
18

19
20
21
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
22
23
    :prog: -m vllm.entrypoints.openai.api_server
    :nodefaultconst: