Skip to content

GitLab

Unverified Commit 5fa0f6ef authored by Lukas Geiger's avatar Lukas Geiger Committed by GitHub
Browse files

[EncoderCacheManager] Remove unnecessary copy (#32800) 


Signed-off-by: default avatarLukas Geiger <lukas.geiger94@gmail.com>
parent bc0d291b
Hide whitespace changes
Inline Side-by-side
Showing with 1 addition and 1 deletion
vllm/v1/core/encoder_cache_manager.py
View file @ 5fa0f6ef
...@@ -237,7 +237,7 @@ class EncoderCacheManager: ...@@ -237,7 +237,7 @@ class EncoderCacheManager:
Typically called when a request is finished, cancelled, or aborted. Typically called when a request is finished, cancelled, or aborted.
""" """
input_ids = self.get_cached_input_ids(request).copy() input_ids = self.get_cached_input_ids(request)
for input_id in input_ids: for input_id in input_ids:
self.free_encoder_input(request, input_id) self.free_encoder_input(request, input_id)
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment