Unverified Commit 70de35a8 authored by Richard Zou's avatar Richard Zou Committed by GitHub
Browse files

Fix erroneous "model doesn't support compile" warning (#16486)


Signed-off-by: default avatarrzou <zou3519@gmail.com>
parent 34b2cf3b
......@@ -3880,7 +3880,9 @@ def set_current_vllm_config(vllm_config: VllmConfig, check_compile=False):
try:
_current_vllm_config = vllm_config
yield
finally:
except Exception:
raise
else:
logger.debug("enabled custom ops: %s",
vllm_config.compilation_config.enabled_custom_ops)
logger.debug("disabled custom ops: %s",
......@@ -3898,6 +3900,7 @@ def set_current_vllm_config(vllm_config: VllmConfig, check_compile=False):
" does not support it. Please open an issue on GitHub"
" if you want it to be supported.",
vllm_config.model_config.model)
finally:
_current_vllm_config = old_vllm_config
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment