GitLab

Support FP8 Quantization and Inference Run on Intel Gaudi (HPU) using INC (Intel Neural Compressor) (#12010)
Signed-off-by: Nir David <ndavid@habana.ai>
Signed-off-by: Uri Livne <ulivne@habana.ai>
Co-authored-by: Uri Livne <ulivne@habana.ai>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: h-avsha <avshalom.manevich@hcompany.ai>

feat - add a new endpoint `get_tokenizer_info` to provide tokenizer/chat-template information (#20575)
Signed-off-by: m-misiura <mmisiura@redhat.com>

Signed-off-by: DarkLight1337 <tlleungac@connect.ust.hk>

Signed-off-by: Chengji Yao <chengjiyao@google.com>

Signed-off-by: qizixi <qizixi@meta.com>
Co-authored-by: qizixi <qizixi@meta.com>

Signed-off-by: Peter Pan <Peter.Pan@daocloud.io>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: Ming Yang <minos.future@gmail.com>

Signed-off-by: reidliu41 <reid201711@gmail.com>

Signed-off-by: Brayden Zhong <b8zhong@uwaterloo.ca>

[Model] Add ModelConfig class for GraniteMoeHybrid to override default max_seq_len_to_capture (#20923)
Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: mgoin <mgoin64@gmail.com>

Signed-off-by: chaunceyjiang <chaunceyjiang@gmail.com>

Signed-off-by: Elfie Guo <elfieg@nvidia.com>
Co-authored-by: Elfie Guo <eflieg@nvidia.com>

Signed-off-by: Chen Li <lcpingping@gmail.com>
Co-authored-by: Russell Bryant <rbryant@redhat.com>
Signed-off-by: Russell Bryant <rbryant@redhat.com>

Signed-off-by: Marko Rosenmueller <5467316+dr75@users.noreply.github.com>

[BugFix] fix 3 issues: (1) using metadata for causal-conv1d, (2) indexing overflow in v1 vLLM, and (3) init_states in v0 (#20838)
Signed-off-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>
Co-authored-by: Tuan M. Hoang-Trong <tmhoangt@us.ibm.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Patrick von Platen <patrick.v.platen@gmail.com>
Co-authored-by: Cyrus Leung <cyrus.tl.leung@gmail.com>

Signed-off-by: Christian Pinto <christian.pinto@ibm.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: wangli <wangli858794774@gmail.com>

Signed-off-by: Thomas Parnell <tpa@zurich.ibm.com>

Signed-off-by: Yifei Teng <tengyifei88@gmail.com>

Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

Signed-off-by: reidliu41 <reid201711@gmail.com>

Signed-off-by: ilmarkov <imarkov@redhat.com>
Co-authored-by: ilmarkov <imarkov@redhat.com>

Signed-off-by: Woosuk Kwon <woosuk.kwon@berkeley.edu>

Signed-off-by: Jennifer He <islandhe@gmail.com>
Signed-off-by: <islandhe@gmail.com>
Signed-off-by: Jen H <islandhe@gmail.com>

Signed-off-by: Boyuan Feng <boyuan@meta.com>

Signed-off-by: Pavani Majety <pmajety@nvidia.com>

Signed-off-by: Ruheena Suhani Shaik <rsshaik@habana.ai>

Signed-off-by: Xiongfei Wei <isaacwxf23@gmail.com>

Signed-off-by: mgoin <mgoin64@gmail.com>