Unverified Commit 9054c882 authored by Krishnan Prashanth's avatar Krishnan Prashanth Committed by GitHub
Browse files

docs: add --prerelease=allow to sglang install commands (#8358)


Signed-off-by: default avatarKrishnan Prashanth <kprashanth@nvidia.com>
parent 26188122
...@@ -122,10 +122,14 @@ Also available: [`tensorrtllm-runtime:1.0.1`](https://docs.nvidia.com/dynamo/res ...@@ -122,10 +122,14 @@ Also available: [`tensorrtllm-runtime:1.0.1`](https://docs.nvidia.com/dynamo/res
### Option B: Install from PyPI ### Option B: Install from PyPI
Install [uv](https://github.com/astral-sh/uv) (`curl -LsSf https://astral.sh/uv/install.sh | sh`), then:
```bash ```bash
pip install "ai-dynamo[sglang]" # or [vllm] or [trtllm] uv pip install --prerelease=allow "ai-dynamo[sglang]" # or [vllm]
``` ```
> **Note:** TensorRT-LLM requires `pip` with `--extra-index-url https://pypi.nvidia.com`. See the [install guide](docs/getting-started/local-installation.md) for TRT-LLM-specific instructions.
Then start the frontend and a worker as shown above. See the [full installation guide](docs/getting-started/local-installation.md) for system dependencies and backend-specific notes. Then start the frontend and a worker as shown above. See the [full installation guide](docs/getting-started/local-installation.md) for system dependencies and backend-specific notes.
### Option C: Kubernetes (recommended) ### Option C: Kubernetes (recommended)
......
...@@ -20,7 +20,7 @@ We recommend using [uv](https://github.com/astral-sh/uv) to install: ...@@ -20,7 +20,7 @@ We recommend using [uv](https://github.com/astral-sh/uv) to install:
```bash ```bash
uv venv --python 3.12 --seed uv venv --python 3.12 --seed
uv pip install "ai-dynamo[sglang]" uv pip install --prerelease=allow "ai-dynamo[sglang]"
``` ```
This installs Dynamo with the compatible SGLang version. This installs Dynamo with the compatible SGLang version.
......
...@@ -104,7 +104,7 @@ docker pull nvcr.io/nvidia/ai-dynamo/snapshot-agent:1.0.1 ...@@ -104,7 +104,7 @@ docker pull nvcr.io/nvidia/ai-dynamo/snapshot-agent:1.0.1
```bash ```bash
# Install Dynamo with a specific backend (Recommended) # Install Dynamo with a specific backend (Recommended)
uv pip install "ai-dynamo[vllm]==1.0.1" uv pip install "ai-dynamo[vllm]==1.0.1"
uv pip install "ai-dynamo[sglang]==1.0.1" uv pip install --prerelease=allow "ai-dynamo[sglang]==1.0.1"
# TensorRT-LLM requires the NVIDIA PyPI index and pip # TensorRT-LLM requires the NVIDIA PyPI index and pip
pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==1.0.1" pip install --pre --extra-index-url https://pypi.nvidia.com "ai-dynamo[trtllm]==1.0.1"
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment