vllm/model_executor/layers/quantization/fp8.py · 889da130e747b1382268ed428352f2e73e51a30b · OpenDAS / vllm_cscc · GitLab

Find file Blame History Permalink

[ Misc ] `fp8-marlin` channelwise via `compressed-tensors` (#6524) · 889da130
Robert Shaw authored Jul 25, 2024
```
Co-authored-by: mgoin <michael@neuralmagic.com>
```
889da130

fp8.py 18.3 KB