"lib/bindings/python/vscode:/vscode.git/clone" did not exist on "19948b7f5a30af254fcb9f3e794cafc7ea766a76"
Unverified Commit 9054c882 authored by Krishnan Prashanth's avatar Krishnan Prashanth Committed by GitHub
Browse files

docs: add --prerelease=allow to sglang install commands (#8358)


Signed-off-by: default avatarKrishnan Prashanth <kprashanth@nvidia.com>
parent 26188122
......@@ -122,10 +122,14 @@ Also available: [`tensorrtllm-runtime:1.0.1`](https://docs.nvidia.com/dynamo/res
### Option B: Install from PyPI
Install [uv](https://github.com/astral-sh/uv) (`curl -LsSf https://astral.sh/uv/install.sh | sh`), then:
```bash
pip install "ai-dynamo[sglang]" # or [vllm] or [trtllm]
uv pip install --prerelease=allow "ai-dynamo[sglang]" # or [vllm]
```
> **Note:** TensorRT-LLM requires `pip` with `--extra-index-url https://pypi.nvidia.com`. See the [install guide](docs/getting-started/local-installation.md) for TRT-LLM-specific instructions.
Then start the frontend and a worker as shown above. See the [full installation guide](docs/getting-started/local-installation.md) for system dependencies and backend-specific notes.
### Option C: Kubernetes (recommended)
......
......@@ -20,7 +20,7 @@ We recommend using [uv](https://github.com/astral-sh/uv) to install:
```bash
uv venv --python 3.12 --seed
uv pip install "ai-dynamo[sglang]"
uv pip install --prerelease=allow "ai-dynamo[sglang]"
```
This installs Dynamo with the compatible SGLang version.
......
......@@ -104,7 +104,7 @@ docker pull nvcr.io/nvidia/ai-dynamo/snapshot-agent:1.0.1
```bash
# Install Dynamo with a specific backend (Recommended)
uv pip install "ai-dynamo[vllm]==1.0.1"
uv pip install "ai-dynamo[sglang]==1.0.1"
uv pip install --prerelease=allow "ai-dynamo[sglang]==1.0.1"
# TensorRT-LLM requires the NVIDIA PyPI index and pip
pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==1.0.1"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment