Unverified Commit 5cc29cfb authored by Zhengxu Chen's avatar Zhengxu Chen Committed by GitHub
Browse files

[compile] Improve error message during artifacts load failure. (#35115)


Signed-off-by: default avatarzhxchen17 <zhxchen17@fb.com>
parent 8fae54fa
...@@ -449,10 +449,15 @@ def _support_torch_compile( ...@@ -449,10 +449,15 @@ def _support_torch_compile(
self.was_aot_compile_fn_loaded_from_disk = True self.was_aot_compile_fn_loaded_from_disk = True
except Exception as e: except Exception as e:
if os.path.exists(aot_compilation_path): if os.path.exists(aot_compilation_path):
if isinstance(e, EOFError):
message = "Compile cache file corrupted."
else:
message = str(e)
logger.warning( logger.warning(
"Cannot load aot compilation from path %s, error: %s", "Compiling model again due to a load failure from %s, "
"reason: %s",
aot_compilation_path, aot_compilation_path,
str(e), message,
) )
if envs.VLLM_FORCE_AOT_LOAD: if envs.VLLM_FORCE_AOT_LOAD:
raise e raise e
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment