Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
abc548c7
"vscode:/vscode.git/clone" did not exist on "5ebf78b3eb8a55ce0e1d100ca55eecde1bbce4f5"
Unverified
Commit
abc548c7
authored
May 12, 2024
by
Lianmin Zheng
Committed by
GitHub
May 12, 2024
Browse files
Minor fix for the import path (#428)
parent
aee4f523
Changes
2
Hide whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
2 additions
and
1 deletion
+2
-1
python/sglang/srt/conversation.py
python/sglang/srt/conversation.py
+1
-1
python/sglang/srt/managers/io_struct.py
python/sglang/srt/managers/io_struct.py
+1
-0
No files found.
python/sglang/srt/conversation.py
View file @
abc548c7
...
@@ -4,7 +4,7 @@ import dataclasses
...
@@ -4,7 +4,7 @@ import dataclasses
from
enum
import
IntEnum
,
auto
from
enum
import
IntEnum
,
auto
from
typing
import
Dict
,
List
,
Optional
,
Tuple
,
Union
from
typing
import
Dict
,
List
,
Optional
,
Tuple
,
Union
from
sglang.srt.
managers.
openai_protocol
import
ChatCompletionRequest
from
sglang.srt.openai_protocol
import
ChatCompletionRequest
class
SeparatorStyle
(
IntEnum
):
class
SeparatorStyle
(
IntEnum
):
...
...
python/sglang/srt/managers/io_struct.py
View file @
abc548c7
...
@@ -25,6 +25,7 @@ class GenerateReqInput:
...
@@ -25,6 +25,7 @@ class GenerateReqInput:
return_text_in_logprobs
:
bool
=
False
return_text_in_logprobs
:
bool
=
False
# Whether to stream output
# Whether to stream output
stream
:
bool
=
False
stream
:
bool
=
False
# TODO: make all parameters a Union[List[T], T] to allow for batched requests
def
post_init
(
self
):
def
post_init
(
self
):
is_single
=
isinstance
(
self
.
text
,
str
)
is_single
=
isinstance
(
self
.
text
,
str
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment