Skip to content

GitLab

"vllm/worker/embedding_model_runner.py" did not exist on "4e12131089f192334f6e09c8fe5cd85af1e25327"
Switch branch/tag
Find file Normal viewHistoryPermalink
serve.md 128 Bytes
Newer Older
Harry Mellor's avatar
[Docs] Add comprehensive CLI reference for all large `vllm` subcommands (#22601)  
Harry Mellor committed
1
2
3
4
5
6
7
8
9 
# vllm bench serve

## JSON CLI Arguments

--8<-- "docs/cli/json_tip.inc.md"

## Options

--8<-- "docs/argparse/bench_serve.md"