Skip to content

GitLab

Commit 50a53887 authored by Ying Sheng's avatar Ying Sheng
Browse files

Update docs

parent 11c8efff
Show whitespace changes
Inline Side-by-side
Showing with 3 additions and 2 deletions
README.md
View file @ 50a53887
...@@ -79,7 +79,7 @@ pip install -U --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/ ...@@ -79,7 +79,7 @@ pip install -U --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/
## Backend: SGLang Runtime (SRT) ## Backend: SGLang Runtime (SRT)
The SGLang Runtime (SRT) is an efficient serving engine. The SGLang Runtime (SRT) is an efficient serving engine.
### Launching a Server ### Quick Start
Launch a server Launch a server
``` ```
python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --port 30000 python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --port 30000
......
docs/sampling_params.md
View file @ 50a53887
...@@ -121,6 +121,7 @@ Download an image ...@@ -121,6 +121,7 @@ Download an image
curl -o example_image.png -L https://github.com/sgl-project/sglang/blob/main/test/lang/example_image.png?raw=true curl -o example_image.png -L https://github.com/sgl-project/sglang/blob/main/test/lang/example_image.png?raw=true
``` ```
Send a request
```python ```python
import requests import requests
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment