Skip to content

GitLab

Switch branch/tag
Find file Normal viewHistoryPermalink
README.md 499 Bytes
Newer Older
raojy's avatar
raw_vllm  
raojy committed
1
2
3
4
5
6
7 
# Examples

vLLM's examples are split into three categories:

- If you are using vLLM from within Python code, see the [Offline Inference](../../examples/offline_inference) section.
- If you are using vLLM from an HTTP application or client, see the [Online Serving](../../examples/online_serving) section.
- For examples of using some of vLLM's advanced features (e.g. LMCache or Tensorizer) which are not specific to either of the above use cases, see the [Others](../../examples/others) section.