Skip to content

GitLab

Unverified Commit 0ee349b5 authored by Roger Wang's avatar Roger Wang Committed by GitHub
Browse files

[V1][Bugfix] Fix assertion when mm hashing is turned off (#12439) 


Signed-off-by: default avatarRoger Wang <ywang@roblox.com>
parent fa63e710
Show whitespace changes
Inline Side-by-side
Showing with 2 additions and 1 deletion
vllm/v1/request.py
View file @ 0ee349b5
...@@ -58,6 +58,7 @@ class Request: ...@@ -58,6 +58,7 @@ class Request:
# Sanity check # Sanity check
assert len(self.mm_inputs) == len(self.mm_positions) assert len(self.mm_inputs) == len(self.mm_positions)
if self.mm_hashes:
assert len(self.mm_inputs) == len(self.mm_hashes) assert len(self.mm_inputs) == len(self.mm_hashes)
# Cache the computed kv block hashes of the request to avoid # Cache the computed kv block hashes of the request to avoid
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment