Unverified Commit a5f89ae2 authored by RickyChen / 陳昭儒's avatar RickyChen / 陳昭儒 Committed by GitHub
Browse files

[Doc] Add documentation for offline API docs feature (#32134)


Signed-off-by: default avatarrickychen-infinirc <ricky.chen@infinirc.com>
parent 05e89812
......@@ -173,6 +173,14 @@ with `--enable-request-id-headers`.
print(completion._request_id)
```
## Offline API Documentation
The FastAPI `/docs` endpoint requires an internet connection by default. To enable offline access in air-gapped environments, use the `--enable-offline-docs` flag:
```bash
vllm serve NousResearch/Meta-Llama-3-8B-Instruct --enable-offline-docs
```
## API Reference
### Completions API
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment