benchmark/benchmark_cache.py · e3cec88aa5b7ac391e4aa6dc9b6388100d59d8f9 · norm / vllm · GitLab

Find file Blame History Permalink

Memcpy kernel for flash attention (#29) · e3cec88a
Siyuan (Ryans) Zhuang authored Apr 10, 2023
```
* optimize

* add benchmark

* add assert

* add test
```
e3cec88a

benchmark_cache.py 2.23 KB