tests/quantization/test_ptpc_fp8.py · eaa92d443743830f9efd35320cf6d440e49283e3 · OpenDAS / vllm_cscc

TJian authored Feb 08, 2025

[ROCm] [Feature] [Doc] [Dockerfile] [BugFix] Support Per-Token-Activation Per-Channel-Weight FP8 Quantization Inferencing (#12501)

eaa92d44

test_ptpc_fp8.py 2.32 KB