Skip to content

GitLab

Unverified Commit d314bf60 authored by Lianmin Zheng's avatar Lianmin Zheng Committed by GitHub
Browse files

Update install.md (#11631)

parent e28c9e52
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 0 deletions
docs/get_started/install.md
View file @ d314bf60
...@@ -51,6 +51,8 @@ docker run --gpus all \ ...@@ -51,6 +51,8 @@ docker run --gpus all \
python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --host 0.0.0.0 --port 30000 python3 -m sglang.launch_server --model-path meta-llama/Llama-3.1-8B-Instruct --host 0.0.0.0 --port 30000
``` ```
You can also find the nightly docker images [here](https://hub.docker.com/r/lmsysorg/sglang/tags?name=nightly).
## Method 4: Using Kubernetes ## Method 4: Using Kubernetes
Please check out [OME](https://github.com/sgl-project/ome), a Kubernetes operator for enterprise-grade management and serving of large language models (LLMs). Please check out [OME](https://github.com/sgl-project/ome), a Kubernetes operator for enterprise-grade management and serving of large language models (LLMs).
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment