engine_args.rst 507 Bytes
Newer Older
1
2
3
4
5
6
7
.. _engine_args:

Engine Arguments
================

Below, you can find an explanation of every engine argument for vLLM:

8
9
10
11
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
    :prog: -m vllm.entrypoints.openai.api_server
12
13
14
15

Async Engine Arguments
----------------------

16
Below are the additional arguments related to the asynchronous engine:
17

18
19
20
21
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
    :prog: -m vllm.entrypoints.openai.api_server