vllm/_custom_ops.py · fa32207842f1ed5a966372ed0513914bff8426c4 · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[Kernel] Optimize FP8 support for MoE kernel / Mixtral via static scales (#4343) · 12628d3c
Philipp Moritz authored Apr 26, 2024
```
Co-authored-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>
```
12628d3c

_custom_ops.py 7.25 KB