Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
zhaoyu6
sglang
Commits
e8a2327d
"git@developer.sourcefind.cn:OpenDAS/torch-cluster.git" did not exist on "7da5a7e6393eecd9a9c22d4693c839a8ba391b41"
Unverified
Commit
e8a2327d
authored
Jun 07, 2024
by
Lianmin Zheng
Committed by
GitHub
Jun 07, 2024
Browse files
Update version to 0.1.17 (#515)
parent
91f93f14
Changes
4
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
5 additions
and
4 deletions
+5
-4
python/pyproject.toml
python/pyproject.toml
+1
-1
python/sglang/__init__.py
python/sglang/__init__.py
+1
-1
python/sglang/global_config.py
python/sglang/global_config.py
+2
-2
python/sglang/srt/managers/controller/infer_batch.py
python/sglang/srt/managers/controller/infer_batch.py
+1
-0
No files found.
python/pyproject.toml
View file @
e8a2327d
...
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
...
@@ -4,7 +4,7 @@ build-backend = "setuptools.build_meta"
[project]
[project]
name
=
"sglang"
name
=
"sglang"
version
=
"0.1.1
6
"
version
=
"0.1.1
7
"
description
=
"A structured generation langauge for LLMs."
description
=
"A structured generation langauge for LLMs."
readme
=
"README.md"
readme
=
"README.md"
requires-python
=
">=3.8"
requires-python
=
">=3.8"
...
...
python/sglang/__init__.py
View file @
e8a2327d
__version__
=
"0.1.1
6
"
__version__
=
"0.1.1
7
"
# SGL API Components
# SGL API Components
from
sglang.api
import
(
from
sglang.api
import
(
...
...
python/sglang/global_config.py
View file @
e8a2327d
...
@@ -26,8 +26,8 @@ class GlobalConfig:
...
@@ -26,8 +26,8 @@ class GlobalConfig:
self
.
concate_and_append_mode
=
"no_adjust"
self
.
concate_and_append_mode
=
"no_adjust"
# Request dependency time due to network delay
# Request dependency time due to network delay
self
.
request_dependency_delay
=
0.0
3
self
.
request_dependency_delay
=
0.0
2
self
.
wait_for_new_request_delay
=
0.000
6
self
.
wait_for_new_request_delay
=
0.000
4
# New generation token ratio estimation
# New generation token ratio estimation
self
.
base_new_token_ratio
=
0.4
self
.
base_new_token_ratio
=
0.4
...
...
python/sglang/srt/managers/controller/infer_batch.py
View file @
e8a2327d
...
@@ -15,6 +15,7 @@ class ForwardMode(IntEnum):
...
@@ -15,6 +15,7 @@ class ForwardMode(IntEnum):
EXTEND
=
auto
()
EXTEND
=
auto
()
DECODE
=
auto
()
DECODE
=
auto
()
class
BaseFinishReason
:
class
BaseFinishReason
:
def
__init__
(
self
,
is_error
:
bool
=
False
):
def
__init__
(
self
,
is_error
:
bool
=
False
):
self
.
is_error
=
is_error
self
.
is_error
=
is_error
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment