benchmarks/kernels/benchmark_paged_attention.py · dacaf5a40056c40be4a84f0aec42278335f76dae · norm / vllm · GitLab

Find file Blame History Permalink

Replace head_mapping params with num_kv_heads to attention kernel. (#1997) · dacaf5a4
wbn authored Dec 11, 2023
```
Co-authored-by: wangguoya <wangguoya@baidu.com>
Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>
```
dacaf5a4

benchmark_paged_attention.py 6.28 KB