vllm/model_executor/layers/attention.py · bda41c70ddb124134935a90a0d51304d2ac035e8 · kecinstone / 2024pra-vllm · GitLab

Find file Blame History Permalink

hotfix attn alibi wo head mapping (#496) · bda41c70
Song authored Jul 19, 2023
```
Co-authored-by: oliveryuan <oliveryuan@basemind.com>
```
bda41c70

attention.py 15.6 KB