GitLab

Signed-off-by: yihong0618 <zouzou0208@gmail.com>

Signed-off-by: Tristan Leclercq <tristanleclercq@gmail.com>

Signed-off-by: Liangfu Chen <liangfc@amazon.com>
Signed-off-by: Matt, Matthias <matthias.matt@tuwien.ac.at>
Co-authored-by: Liangfu Chen <liangfc@amazon.com>
Co-authored-by: mgoin <michael@neuralmagic.com>

Signed-off-by: chaow <chaow@amd.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Signed-off-by: Ce Gao <cegao@tensorchord.ai>

Signed-off-by: Alex-Brooks <Alex.brooks@ibm.com>
Co-authored-by: Joe Runde <joe@joerun.de>

Signed-off-by: WangErXiao <863579016@qq.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Bryan Lu <yuzhelu@amazon.com>

Signed-off-by: yasu52 <tsuguro4649@gmail.com>

Signed-off-by: WangErXiao <863579016@qq.com>

Signed-off-by: WangErXiao <863579016@qq.com>

Signed-off-by: liuyanyi <wolfsonliu@163.com>

Signed-off-by: mgoin <mgoin64@gmail.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Ce Gao <cegao@tensorchord.ai>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Joe Runde <Joseph.Runde@ibm.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Shangming Cai <caishangming@linux.alibaba.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Yuan Tang <terrytangyuan@gmail.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Based on a request by @mgoin , with @kylesayrs we have added an example
doc for int4 w4a16 quantization, following the pre-existing int8 w8a8
quantization example and the example available in
[`llm-compressor`](https://github.com/vllm-project/llm-compressor/blob/main/examples/quantization_w4a16/llama3_example.py

)

FIX #n/a (no issue created)

@kylesayrs and I have discussed a couple additional improvements for the
quantization docs. We will revisit at a later date, possibly including:
- A section for "choosing the correct quantization scheme/ compression
technique"
- Additional vision or audio calibration datasets

---------
Signed-off-by: Brian Dellabetta <bdellabe@redhat.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Ce Gao <cegao@tensorchord.ai>
Co-authored-by: Rafael Vasquez <rafvasq21@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>
Co-authored-by: Michael Goin <mgoin@redhat.com>

Signed-off-by: Russell Bryant <rbryant@redhat.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

Signed-off-by: mgoin <michael@neuralmagic.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Signed-off-by: Kyle Sayers <kylesayrs@gmail.com>

Signed-off-by: tjtanaa <tunjian.tan@embeddedllm.com>
Co-authored-by: tjtanaa <tunjian.tan@embeddedllm.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>