Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
f6f46f46
Unverified
Commit
f6f46f46
authored
Jul 31, 2025
by
Simo Lin
Committed by
GitHub
Jul 31, 2025
Browse files
[router] add basic usage doc (#8640)
parent
2886e23d
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
23 additions
and
0 deletions
+23
-0
sgl-router/README.md
sgl-router/README.md
+23
-0
No files found.
sgl-router/README.md
View file @
f6f46f46
...
@@ -54,12 +54,35 @@ pip install -e .
...
@@ -54,12 +54,35 @@ pip install -e .
```
bash
```
bash
# Build Rust components
# Build Rust components
cargo build
cargo build
```
#### Launch Router with Worker URLs in regular mode
```
bash
# Launch router with worker URLs
# Launch router with worker URLs
python
-m
sglang_router.launch_router
\
python
-m
sglang_router.launch_router
\
--worker-urls
http://worker1:8000 http://worker2:8000
--worker-urls
http://worker1:8000 http://worker2:8000
```
```
#### Launch Router with Worker URLs in prefill-decode mode
```
bash
# Note that the prefill and decode URLs must be provided in the following format:
# http://<ip>:<port> for decode nodes
# http://<ip>:<port> bootstrap-port for prefill nodes, where bootstrap-port is optional
# Launch router with worker URLs
python
-m
sglang_router.launch_router
\
--pd-disaggregation
\
--policy
cache_aware
\
--prefill
http://127.0.0.1:30001 9001
\
--prefill
http://127.0.0.2:30002 9002
\
--prefill
http://127.0.0.3:30003 9003
\
--prefill
http://127.0.0.4:30004 9004
\
--decode
http://127.0.0.5:30005
\
--decode
http://127.0.0.6:30006
\
--decode
http://127.0.0.7:30007
\
--host
0.0.0.0
\
--port
8080
```
`
## Configuration
## Configuration
### Logging
### Logging
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment