Skip to content

GitLab

"lib/llm/tests/vscode:/vscode.git/clone" did not exist on "e63d728fad21d7aa3162413d17d6fed2f1afd920"
Unverified Commit a5f89ae2 authored by RickyChen / 陳昭儒's avatar RickyChen / 陳昭儒 Committed by GitHub
Browse files

[Doc] Add documentation for offline API docs feature (#32134) 


Signed-off-by: default avatarrickychen-infinirc <ricky.chen@infinirc.com>
parent 05e89812
Hide whitespace changes
Inline Side-by-side
Showing with 8 additions and 0 deletions
docs/serving/openai_compatible_server.md
View file @ a5f89ae2
...@@ -173,6 +173,14 @@ with `--enable-request-id-headers`. ...@@ -173,6 +173,14 @@ with `--enable-request-id-headers`.
print(completion._request_id) print(completion._request_id)
``` ```
## Offline API Documentation
The FastAPI `/docs` endpoint requires an internet connection by default. To enable offline access in air-gapped environments, use the `--enable-offline-docs` flag:
```bash
vllm serve NousResearch/Meta-Llama-3-8B-Instruct --enable-offline-docs
```
## API Reference ## API Reference
### Completions API ### Completions API
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment