Unverified Commit 4c0d93f4 authored by Murali Andoorveedu's avatar Murali Andoorveedu Committed by GitHub
Browse files

[V1][Bugfix] Copy encoder input ids to fix set iteration issue during VLM abort (#13173)


Signed-off-by: default avatarandoorve <37849411+andoorve@users.noreply.github.com>
parent 14b7899d
...@@ -54,7 +54,7 @@ class EncoderCacheManager: ...@@ -54,7 +54,7 @@ class EncoderCacheManager:
def free(self, request: Request) -> None: def free(self, request: Request) -> None:
"""Free all cached input ids for the request.""" """Free all cached input ids for the request."""
input_ids = self.get_cached_input_ids(request) input_ids = self.get_cached_input_ids(request).copy()
for input_id in input_ids: for input_id in input_ids:
self.free_encoder_input(request, input_id) self.free_encoder_input(request, input_id)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment