"tests/async_engine/test_openapi_server.py" did not exist on "5bf35a91e465278b51b0c98fa1b13beb8b04d431"
engine_args.md 605 Bytes
Newer Older
1
(engine-args)=
2

3
# Engine Arguments
4
5
6

Below, you can find an explanation of every engine argument for vLLM:

7
<!--- pyml disable-num-lines 7 no-space-in-emphasis-->
8
```{eval-rst}
9
10
11
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _engine_args_parser
12
    :prog: vllm serve
13
    :nodefaultconst:
14
```
15

16
## Async Engine Arguments
17

18
Below are the additional arguments related to the asynchronous engine:
19

20
<!--- pyml disable-num-lines 7 no-space-in-emphasis-->
21
```{eval-rst}
22
23
24
.. argparse::
    :module: vllm.engine.arg_utils
    :func: _async_engine_args_parser
25
    :prog: vllm serve
26
27
    :nodefaultconst:
```