Unverified Commit 69db16a4 authored by Chenyaaang's avatar Chenyaaang Committed by GitHub
Browse files

add platform check back (#15578)


Signed-off-by: default avatarChenyaaang <llccyy1212@gmail.com>
parent ce78f9af
...@@ -137,6 +137,9 @@ class Processor: ...@@ -137,6 +137,9 @@ class Processor:
f" != {engine_level_backend}") f" != {engine_level_backend}")
else: else:
params.guided_decoding.backend = engine_level_backend params.guided_decoding.backend = engine_level_backend
import vllm.platforms
if vllm.platforms.current_platform.is_tpu():
raise ValueError("Structured output is not supported on TPU.")
# Request content validation # Request content validation
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment