Skip to content

GitLab

Unverified Commit f7f88b70 authored by David Carreto Fidalgo's avatar David Carreto Fidalgo Committed by GitHub
Browse files

HotFix: json serialization error when using OAI v1/batches endpoint with logprobs (#3896)

parent 18c27131
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/openai_api/adapter.py
View file @ f7f88b70
...@@ -1147,7 +1147,7 @@ def v1_chat_generate_response( ...@@ -1147,7 +1147,7 @@ def v1_chat_generate_response(
"tool_calls": tool_calls, "tool_calls": tool_calls,
"reasoning_content": reasoning_text, "reasoning_content": reasoning_text,
}, },
"logprobs": choice_logprobs, "logprobs": choice_logprobs.model_dump() if choice_logprobs else None,
"finish_reason": (finish_reason["type"] if finish_reason else ""), "finish_reason": (finish_reason["type"] if finish_reason else ""),
"matched_stop": ( "matched_stop": (
finish_reason["matched"] finish_reason["matched"]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment