"vllm/vscode:/vscode.git/clone" did not exist on "d69ff0cbbbb07b571eeea62b4e2ce87b91cea387"
Unverified Commit 5cc29cfb authored by Zhengxu Chen's avatar Zhengxu Chen Committed by GitHub
Browse files

[compile] Improve error message during artifacts load failure. (#35115)


Signed-off-by: default avatarzhxchen17 <zhxchen17@fb.com>
parent 8fae54fa
......@@ -449,10 +449,15 @@ def _support_torch_compile(
self.was_aot_compile_fn_loaded_from_disk = True
except Exception as e:
if os.path.exists(aot_compilation_path):
if isinstance(e, EOFError):
message = "Compile cache file corrupted."
else:
message = str(e)
logger.warning(
"Cannot load aot compilation from path %s, error: %s",
"Compiling model again due to a load failure from %s, "
"reason: %s",
aot_compilation_path,
str(e),
message,
)
if envs.VLLM_FORCE_AOT_LOAD:
raise e
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment