Unverified Commit 39c89e71 authored by Travis Johnson's avatar Travis Johnson Committed by GitHub
Browse files

[Misc] Update llama 3.2 template to support system prompt with images (#10901)


Signed-off-by: default avatarTravis Johnson <tsjohnso@us.ibm.com>
parent 1f958a7d
......@@ -26,13 +26,11 @@
{%- endfor %}
{%- endfor %}
{#- This block extracts the system message, so we can slot it into the right place. #}
{%- if messages[0]['role'] == 'system' %}
{%- if messages[0]['content'] is string %}
{%- set system_message = messages[0]['content']|trim %}
{%- else %}
{#- Support vLLM's transforming of a content string to JSON. #}
{%- set system_message = messages[0]['content'][0]['text']|trim %}
{%- endif %}
{%- set messages = messages[1:] %}
......@@ -44,14 +42,8 @@
{%- endif %}
{%- endif %}
{#- Including an image is not compatible with a system message #}
{%- if image_ns.has_images and not system_message == "" %}
{{- raise_exception("Prompting with images is incompatible with system messages and tool use.") }}
{%- endif %}
{#- System message, if there are no images #}
{%- if not image_ns.has_images %}
{#- System message if there are no images, if the user supplied one, or if tools are used (default tool system message) #}
{%- if system_message or not image_ns.has_images %}
{{- "<|start_header_id|>system<|end_header_id|>\n\n" }}
{%- if tools is not none %}
{{- "Environment: ipython\n" }}
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment