vllm/engine/arg_utils.py · 70116459c3d1d52cae954cf0f644203e9f0d3a3c · OpenDAS / vllm_cscc

"tests/entrypoints/test_ssl_cert_refresher.py" did not exist on "2382ad29d1769f2b46d51fcc2cedbd6e00d4f180"

[Quantization][FP8] Add support for FP8 models with input_scale for output... · a41351f3

rasmith authored Apr 25, 2025


[Quantization][FP8] Add support for FP8 models with input_scale for output projection and QK quantization (#15734)
Signed-off-by: Randall Smith <Randall.Smith@amd.com>
Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Co-authored-by: Luka Govedič <lgovedic@redhat.com>

a41351f3

arg_utils.py 77.6 KB

Replace arg_utils.py