Skip to content

GitLab

Unverified Commit 5f77ef15 authored by Matthew Bonanni's avatar Matthew Bonanni Committed by GitHub
Browse files

[Misc][Attention] Clean up unused method in `CPU_ATTN` (#36673) 


Signed-off-by: default avatarMatthew Bonanni <mbonanni@redhat.com>
parent 7d6abdd0
Show whitespace changes
Inline Side-by-side
Showing with 0 additions and 4 deletions
vllm/v1/attention/backends/cpu_attn.py
View file @ 5f77ef15
...@@ -36,10 +36,6 @@ class CPUAttentionBackend(AttentionBackend): ...@@ -36,10 +36,6 @@ class CPUAttentionBackend(AttentionBackend):
torch.float32, torch.float32,
] ]
@classmethod
def get_supported_dtypes(cls) -> list[torch.dtype]:
return [torch.float16, torch.bfloat16, torch.float32]
@classmethod @classmethod
def get_supported_head_sizes(cls) -> list[int]: def get_supported_head_sizes(cls) -> list[int]:
return [32, 64, 80, 96, 112, 128, 160, 192, 224, 256] return [32, 64, 80, 96, 112, 128, 160, 192, 224, 256]
......
Markdown is supported
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment