Skip to content

GitLab

Unverified Commit 010acc6e authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Bugfix] Fix incompatibility between #20452 and #24548 (#24754) 


Signed-off-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent c8c42597
Hide whitespace changes
Inline Side-by-side
Showing with 2 additions and 4 deletions
vllm/v1/executor/utils.py
View file @ 010acc6e
...@@ -19,7 +19,5 @@ def get_and_update_mm_cache( ...@@ -19,7 +19,5 @@ def get_and_update_mm_cache(
""" """
scheduler_output = args[0] scheduler_output = args[0]
for request_data in scheduler_output.scheduled_new_reqs: for request_data in scheduler_output.scheduled_new_reqs:
for i in range(len(request_data.mm_kwargs)): request_data.mm_features = receiver_cache.get_and_update_features(
mm_input = request_data.mm_kwargs[i] request_data.mm_features)
request_data.mm_kwargs[i] = \
receiver_cache.get_and_update_item(mm_input, None)
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment