vllm/v1/attention/ops/triton_turboquant_decode.py · f4b42df04847dcbd3247f7f4c56dff45e40bdf0d · OpenDAS / vllm_cscc

"docs/benchmarking/cli.md" did not exist on "8bff831f0aa239006f34b721e63e1340e3472067"

[Attention Backend] TurboQuant: 2-bit KV cache compression with 4x capacity (#38479) · f4b42df0

Vibhav Agarwal authored Apr 15, 2026


Signed-off-by: vibhavagarwal5 <vibhavagarwal5@gmail.com>
Signed-off-by: Michael Goin <mgoin64@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Michael Goin <mgoin64@gmail.com>

f4b42df0

triton_turboquant_decode.py 21.7 KB

Replace triton_turboquant_decode.py