"...git@developer.sourcefind.cn:2222/OpenDAS/vllm_cscc.git" did not exist on "5b23c3f26fcf08fdbe2b7e6beecb4d970e632897"
Unverified Commit 0ee349b5 authored by Roger Wang's avatar Roger Wang Committed by GitHub
Browse files

[V1][Bugfix] Fix assertion when mm hashing is turned off (#12439)


Signed-off-by: default avatarRoger Wang <ywang@roblox.com>
parent fa63e710
...@@ -58,7 +58,8 @@ class Request: ...@@ -58,7 +58,8 @@ class Request:
# Sanity check # Sanity check
assert len(self.mm_inputs) == len(self.mm_positions) assert len(self.mm_inputs) == len(self.mm_positions)
assert len(self.mm_inputs) == len(self.mm_hashes) if self.mm_hashes:
assert len(self.mm_inputs) == len(self.mm_hashes)
# Cache the computed kv block hashes of the request to avoid # Cache the computed kv block hashes of the request to avoid
# recomputing. # recomputing.
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment