benchmarks/kernels/benchmark_paged_attention.py · 7d648418b8b1aadb90489ef18cff1763ffc82ed5 · xdb4_94051 / vllm · GitLab

"megatron/vscode:/vscode.git/clone" did not exist on "682339329d613bf088b7c6350f00079816e0d5c7"

Find file Blame History Permalink

Replace head_mapping params with num_kv_heads to attention kernel. (#1997) · dacaf5a4
wbn authored Dec 11, 2023
```
Co-authored-by: wangguoya <wangguoya@baidu.com>
Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>
```
dacaf5a4

benchmark_paged_attention.py 6.28 KB