Skip to content

GitLab

Unverified Commit cdba4c74 authored by Cyrus Leung's avatar Cyrus Leung Committed by GitHub
Browse files

[Model] Avoid token selection in SigLIP pooling head (#32389) 


Signed-off-by: default avatarDarkLight1337 <tlleungac@connect.ust.hk>
parent a52d1396
Hide whitespace changes
Inline Side-by-side
Showing with 3 additions and 3 deletions
vllm/model_executor/models/siglip.py
View file @ cdba4c74
...@@ -690,9 +690,9 @@ class SiglipMultiheadAttentionPoolingHead(nn.Module): ...@@ -690,9 +690,9 @@ class SiglipMultiheadAttentionPoolingHead(nn.Module):
hidden_state = self.mlp(hidden_state) hidden_state = self.mlp(hidden_state)
hidden_state += residual hidden_state += residual
pooled = hidden_state[:, 0] # Handled by resolve_visual_encoder_outputs
# return hidden_state[:, 0]
return pooled.unsqueeze(1) return hidden_state
class SiglipVisionTransformer(nn.Module): class SiglipVisionTransformer(nn.Module):
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment