"vscode:/vscode.git/clone" did not exist on "4d004650c9aa48fcad827d0096b773e3b59727ef"
Unverified Commit 4c0d93f4 authored by Murali Andoorveedu's avatar Murali Andoorveedu Committed by GitHub
Browse files

[V1][Bugfix] Copy encoder input ids to fix set iteration issue during VLM abort (#13173)


Signed-off-by: default avatarandoorve <37849411+andoorve@users.noreply.github.com>
parent 14b7899d
......@@ -54,7 +54,7 @@ class EncoderCacheManager:
def free(self, request: Request) -> None:
"""Free all cached input ids for the request."""
input_ids = self.get_cached_input_ids(request)
input_ids = self.get_cached_input_ids(request).copy()
for input_id in input_ids:
self.free_encoder_input(request, input_id)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment