GitLab

Integrates the block-quantized kernels introduced in
https://github.com/vllm-project/vllm/pull/11868

 for use in linear
layers.
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Lu Fang <lufang@fb.com>

Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

Co-authored-by: Faraz Shahsavan <faraz.shahsavan@gmail.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>

Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: youkaichao <youkaichao@126.com>

Signed-off-by: Hanzhi Zhou <hanzhi713@gmail.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: charlifu <charlifu@amd.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Co-authored-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Divakar Verma <137818590+divakar-amd@users.noreply.github.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Co-authored-by: Sage Moore <sage@neuralmagic.com>

Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Co-authored-by: Michael Goin <michael@neuralmagic.com>