GitLab

This reverts commit 33485749.

This reverts commit 93fae6b1.

增加fused moe文件中w4a8的相关修改
fix: 修复W8A8读config路径错误，删除int8_utils.py文件
fix: 修复W8A8INT8读config问题
修改W4A8 以及W8A8量化量化092接口

Signed-off-by: Hardik <hardikgupta1999@gmail.com>
Signed-off-by: Isotr0py <2037008807@qq.com>
Co-authored-by: Isotr0py <2037008807@qq.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: Christian Pinto <christian.pinto@ibm.com>

Signed-off-by: Asher Zhang <asherszhang@tencent.com>

Signed-off-by: youkaichao <youkaichao@gmail.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Isotr0py <2037008807@qq.com>

Signed-off-by: Chendi.Xue <chendi.xue@intel.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>

Signed-off-by: raushan <raushan@huggingface.co>

Signed-off-by: bbartels <benjamin@bartels.dev>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Duncan Moss <djm.moss@gmail.com>
Signed-off-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: jiahanc <173873397+jiahanc@users.noreply.github.com>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>