benchmarks/kernels/benchmark_paged_attention.py · dacaf5a40056c40be4a84f0aec42278335f76dae · xdb4_94051 / vllm · GitLab

"test/srt/test_eagle_infer_b.py" did not exist on "6222e1c2282766189adbdf1c0335725d2759f84c"

Find file Blame History Permalink

Replace head_mapping params with num_kv_heads to attention kernel. (#1997) · dacaf5a4
wbn authored Dec 11, 2023
```
Co-authored-by: wangguoya <wangguoya@baidu.com>
Co-authored-by: Yang Zhao <zhaoyangstar@foxmail.com>
```
dacaf5a4

benchmark_paged_attention.py 6.28 KB