"docs/vscode:/vscode.git/clone" did not exist on "ef65dcfa6f5820ce9e4a2411e9be18586f6fd467"
README.md 424 Bytes
Newer Older
1
2
3
4
5
6
7
# Examples

vLLM's examples are split into three categories:

- If you are using vLLM from within Python code, see [Offline Inference](./offline_inference/)
- If you are using vLLM from an HTTP application or client, see [Online Serving](./online_serving/)
- For examples of using some of vLLM's advanced features (e.g. LMCache or Tensorizer) which are not specific to either of the above use cases, see [Others](./others/)