Skip to content

GitLab

Unverified Commit 24161c59 authored by Yury Sulsky's avatar Yury Sulsky Committed by GitHub
Browse files

The Gemma template is missing a newline after the user role. (#6331) 


Co-authored-by: default avatarYury Sulsky <ysulsky@tesla.com>
parent eabcf82a
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
python/sglang/srt/conversation.py
View file @ 24161c59
......@@ -781,7 +781,7 @@ register_conv_template(
Conversation(
name="gemma-it",
system_message="You are a helpful assistant.",
system_template="<start_of_turn>user{system_message}\n\n",
system_template="<start_of_turn>user\n{system_message}\n\n",
roles=("<start_of_turn>user\n", "<start_of_turn>model\n"),
sep="<end_of_turn>\n",
sep_style=SeparatorStyle.GEMMA3,
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment