Skip to content
GitLab
Menu
Projects
Groups
Snippets
Loading...
Help
Help
Support
Community forum
Keyboard shortcuts
?
Submit feedback
Contribute to GitLab
Sign in
Toggle navigation
Menu
Open sidebar
OpenDAS
vllm_cscc
Commits
b8747e8a
Unverified
Commit
b8747e8a
authored
Sep 23, 2024
by
Cody Yu
Committed by
GitHub
Sep 24, 2024
Browse files
[MISC] Skip dumping inputs when unpicklable (#8744)
parent
3185fb0c
Changes
1
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
9 additions
and
1 deletion
+9
-1
vllm/worker/model_runner_base.py
vllm/worker/model_runner_base.py
+9
-1
No files found.
vllm/worker/model_runner_base.py
View file @
b8747e8a
...
...
@@ -137,7 +137,15 @@ def dump_input_when_exception(exclude_args: Optional[List[int]] = None,
for
t
in
kv_caches
if
is_tensor
(
t
)]
pickle
.
dump
(
dumped_inputs
,
filep
)
try
:
pickle
.
dump
(
dumped_inputs
,
filep
)
except
Exception
as
pickle_err
:
logger
.
warning
(
"Failed to pickle inputs of failed execution: %s"
,
str
(
pickle_err
))
raise
type
(
err
)(
f
"Error in model execution: "
f
"
{
str
(
err
)
}
"
)
from
err
logger
.
info
(
"Completed writing input of failed execution to %s."
,
filename
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
.
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment