Skip to content

GitLab

"vscode:/vscode.git/clone" did not exist on "9380e58821092ad05e618fa8a259030136ba43c0"
Unverified Commit 1d9deeac authored by LI MOU's avatar LI MOU Committed by GitHub
Browse files

fix missing ignore_eos in v1/chat/completions (#1642)

parent dafb6a52
Show whitespace changes
Inline Side-by-side
Showing with 1 addition and 0 deletions
python/sglang/srt/openai_api/adapter.py
View file @ 1d9deeac
...@@ -910,6 +910,7 @@ def v1_chat_generate_request( ...@@ -910,6 +910,7 @@ def v1_chat_generate_request(
"repetition_penalty": request.repetition_penalty, "repetition_penalty": request.repetition_penalty,
"regex": request.regex, "regex": request.regex,
"n": request.n, "n": request.n,
"ignore_eos": request.ignore_eos,
} }
if request.response_format and request.response_format.type == "json_schema": if request.response_format and request.response_format.type == "json_schema":
sampling_params["json_schema"] = convert_json_schema_to_str( sampling_params["json_schema"] = convert_json_schema_to_str(
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment