Commit 50a53887 authored by Ying Sheng's avatar Ying Sheng
Browse files

Update docs

parent 11c8efff
......@@ -79,7 +79,7 @@ pip install -U --index-url https://aiinfra.pkgs.visualstudio.com/PublicPackages/
## Backend: SGLang Runtime (SRT)
The SGLang Runtime (SRT) is an efficient serving engine.
### Launching a Server
### Quick Start
Launch a server
```
python -m sglang.launch_server --model-path meta-llama/Meta-Llama-3-8B-Instruct --port 30000
......
......@@ -121,6 +121,7 @@ Download an image
curl -o example_image.png -L https://github.com/sgl-project/sglang/blob/main/test/lang/example_image.png?raw=true
```
Send a request
```python
import requests
......@@ -139,4 +140,4 @@ print(response.json())
```
The `image_data` can be a file name, a URL, or a base64 encoded string. See also `python/sglang/srt/utils.py:load_image`.
Streaming is supported in a similar manner as [above](#streaming).
\ No newline at end of file
Streaming is supported in a similar manner as [above](#streaming).
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment