GitLab

增加fused moe文件中w4a8的相关修改
fix: 修复W8A8读config路径错误，删除int8_utils.py文件
fix: 修复W8A8INT8读config问题
修改W4A8 以及W8A8量化量化092接口

Signed-off-by: Julien Denize <julien.denize@mistral.ai>

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Signed-off-by: Nick Hill <nhill@redhat.com>
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Nick Hill <nhill@redhat.com>
Co-authored-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: Ma, Liangliang <liangliang.ma@intel.com>

Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: 22quinn <33176974+22quinn@users.noreply.github.com>

Signed-off-by: Yong Hoon Shin <yhshin@meta.com>

Signed-off-by: Christian Pinto <christian.pinto@ibm.com>

Signed-off-by: Nick Hill <nhill@redhat.com>

Signed-off-by: Asher Zhang <asherszhang@tencent.com>

Signed-off-by: Yang Chen <yangche@fb.com>

Signed-off-by: Yu Chin Fabian Lim <flim@sg.ibm.com>

Signed-off-by: Lu Fang <lufang@fb.com>

Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

Signed-off-by: Isotr0py <2037008807@qq.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: simon-mo <xmo@berkeley.edu>
Co-authored-by: simon-mo <xmo@berkeley.edu>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

[Bugfix] Decode Tokenized IDs to Strings for `hf_processor` in `llm.chat()` with `model_impl=transformers` (#21353)
Signed-off-by: ariG23498 <aritra.born2fly@gmail.com>

Signed-off-by: raushan <raushan@huggingface.co>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Mickael Seznec <mickael@mistral.ai>
Co-authored-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

[Core] Introduce popleft_n and append_n in FreeKVCacheBlockQueue to further optimize block_pool (#21222)
Signed-off-by: Jialin Ouyang <Jialin.Ouyang@gmail.com>

Signed-off-by: Kebe <mail@kebe7jun.com>

Signed-off-by: alyosha-swamy <raghav@arcee.ai>
Signed-off-by: Jee Jee Li <pandaleefree@gmail.com>
Co-authored-by: Jee Jee Li <pandaleefree@gmail.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: Ming Yang <minos.future@gmail.com>

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

Signed-off-by: Ming Yang <minos.future@gmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

Signed-off-by: simpx <simpxx@gmail.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Zhiyu Cheng <zhiyuc@nvidia.com>

Signed-off-by: Andy Xie <andy.xning@gmail.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>