Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in / Register
Toggle navigation
Menu
Open sidebar
change
sglang
Commits
5be9eb8a
"vscode:/vscode.git/clone" did not exist on "f4178a2a991922247ce9b99e92053f353cb88329"
Unverified
Commit
5be9eb8a
authored
May 17, 2024
by
Ying Sheng
Committed by
GitHub
May 17, 2024
Browse files
Add PUT for generate api (#448)
parent
c05956e5
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
4 additions
and
1 deletion
+4
-1
python/sglang/srt/server.py
python/sglang/srt/server.py
+4
-1
No files found.
python/sglang/srt/server.py
View file @
5be9eb8a
...
...
@@ -81,7 +81,6 @@ async def flush_cache():
)
@
app
.
post
(
"/generate"
)
async
def
generate_request
(
obj
:
GenerateReqInput
):
obj
.
post_init
()
...
...
@@ -98,8 +97,12 @@ async def generate_request(obj: GenerateReqInput):
ret
=
await
tokenizer_manager
.
generate_request
(
obj
).
__anext__
()
return
ret
except
ValueError
as
e
:
print
(
f
"Error:
{
e
}
"
)
return
JSONResponse
({
"error"
:
str
(
e
)},
status_code
=
400
)
app
.
post
(
"/generate"
)(
generate_request
)
app
.
put
(
"/generate"
)(
generate_request
)
@
app
.
post
(
"/v1/completions"
)
async
def
openai_v1_completions
(
raw_request
:
Request
):
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment