Skip to content

GitLab

Unverified Commit de00ebea authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Bugfix] Fix simple Mistral-Small example (#36156) 


Signed-off-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent 639680d2
Hide whitespace changes
Inline Side-by-side
Showing with 5 additions and 2 deletions
examples/offline_inference/mistral-small.py
View file @ de00ebea
...@@ -7,6 +7,7 @@ import argparse ...@@ -7,6 +7,7 @@ import argparse
from vllm import LLM from vllm import LLM
from vllm.sampling_params import SamplingParams from vllm.sampling_params import SamplingParams
from vllm.assets.image import ImageAsset from vllm.assets.image import ImageAsset
from vllm.multimodal.utils import encode_image_url
# This script is an offline demo for running Mistral-Small-3.1 # This script is an offline demo for running Mistral-Small-3.1
# #
...@@ -79,8 +80,10 @@ def run_simple_demo(args: argparse.Namespace): ...@@ -79,8 +80,10 @@ def run_simple_demo(args: argparse.Namespace):
"content": [ "content": [
{"type": "text", "text": prompt}, {"type": "text", "text": prompt},
{ {
"type": "image_pil", "type": "image_url",
"image_pil": ImageAsset("cherry_blossom").pil_image, "image_url": {
"url": encode_image_url(ImageAsset("cherry_blossom").pil_image)
},
}, },
], ],
}, },
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment