vllm/config.py · 2072924d1480460d3b3578a4548c2bffe33fe1c3 · OpenDAS / vllm_cscc

"tests/quantization/untest_fp8.py" did not exist on "22375f8d13dbf5c201c6f1564f72310193930816"

[Model] [Quantization] Support deepseek_v3 w8a8 fp8 block-wise quantization (#11523) · 2072924d

Michael Goin authored Dec 26, 2024


Signed-off-by: mgoin <michael@neuralmagic.com>
Signed-off-by: simon-mo <simon.mo@hey.com>
Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <simon.mo@hey.com>
Co-authored-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: HandH1998 <1335248067@qq.com>

2072924d

config.py 143 KB

Replace config.py