Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
86c37d01
Unverified
Commit
86c37d01
authored
Nov 11, 2024
by
Byron Hsu
Committed by
GitHub
Nov 11, 2024
Browse files
fix sglang_router not found (#2005)
parent
f18b9c72
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
3 additions
and
5 deletions
+3
-5
rust/demo.py
rust/demo.py
+1
-3
rust/py_src/sglang_router/__init__.py
rust/py_src/sglang_router/__init__.py
+1
-1
rust/py_src/sglang_router/router.py
rust/py_src/sglang_router/router.py
+0
-0
rust/pyproject.toml
rust/pyproject.toml
+1
-1
No files found.
rust/demo.py
View file @
86c37d01
...
...
@@ -4,9 +4,7 @@ router = Router(
worker_urls
=
[
"http://localhost:30000"
,
"http://localhost:30001"
,
],
policy
=
PolicyType
.
ApproxTree
,
tokenizer_path
=
"/shared/public/elr-models/meta-llama/Meta-Llama-3.1-8B-Instruct/07eb05b21d191a58c577b4a45982fe0c049d0693/tokenizer.json"
,
]
)
router
.
start
()
rust/py_src/__init__.py
→
rust/py_src/
sglang_router/
__init__.py
View file @
86c37d01
# a lightweihgt wrapper on router with argument type and comments
# no wrapper on policy type => direct export
from
sglang_router_rs
import
PolicyType
# no wrapper on policy type => direct export
from
.router
import
Router
rust/py_src/router.py
→
rust/py_src/
sglang_router/
router.py
View file @
86c37d01
File moved
rust/pyproject.toml
View file @
86c37d01
...
...
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
[project]
name
=
"sglang-router"
version
=
"0.0.
3
"
version
=
"0.0.
4
"
description
=
"SGLang router is a standalone module implemented in Rust to achieve data parallelism across SGLang instances."
authors
=
[
{name
=
"Byron Hsu"
,
email
=
"byronhsu1230@gmail.com"
}
]
requires-python
=
">=3.8"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment