vllm/model_executor/layers/quantization/fp8.py · 54cacf008f00d35d46273fed4d538cf5740d0965 · OpenDAS / vllm_cscc

Elfie Guo authored Jan 15, 2025


Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

fa0050db

fp8.py 29.4 KB