csrc/quantization/fp8/fp8_cuda_kernels.cu · 12628d3c787efd3483aaa74b5ae4175b28fd5805 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Kernel] Optimize FP8 support for MoE kernel / Mixtral via static scales (#4343) · 12628d3c
Philipp Moritz authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
12628d3c

fp8_cuda_kernels.cu 3.84 KB