vllm/attention/ops/prefix_prefill.py · a046f86397c06af306d964ff40d0670bdc9c00a2 · OpenDAS / vllm_cscc · GitLab

"vllm/vscode:/vscode.git/clone" did not exist on "6428f1d051d731a9eca192950591e7a5a2788cb2"

Find file Blame History Permalink

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) · a046f863
jon-chuang authored Aug 12, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
a046f863

prefix_prefill.py 30.4 KB