docs/source/quantization/fp8_e5m2_kvcache.rst · ad385667103b7a98fee5a4fc46d2a7745407333e · OpenDAS / vllm_cscc · GitLab

"tests/models/quantization/test_awq.py" did not exist on "6b29d6fe709b91346be102a697bfaea386ed9107"

Find file Blame History Permalink

[Core/Bugfix] Add FP8 K/V Scale and dtype conversion for prefix/prefill Triton Kernel (#7208) · a046f863
jon-chuang authored Aug 12, 2024
```
Co-authored-by: Cody Yu <hao.yu.cody@gmail.com>
```
a046f863

fp8_e5m2_kvcache.rst 1.17 KB