- 03 Feb, 2025 1 commit
-
-
Arthur authored
# Adds support for `transformers` as a backend Following https://github.com/huggingface/transformers/pull/35235 , a bunch of models should already be supported, we are ramping up support for more models. Thanks @Isotr0py for the TP support, and @hmellor for his help as well! This includes: - `trust_remote_code=True` support: any model on the hub, if it implements attention the correct way can be natively supported!! - tensor parallel support --------- Signed-off-by:
Harry Mellor <19981378+hmellor@users.noreply.github.com> Signed-off-by:
Isotr0py <2037008807@qq.com> Co-authored-by:
Isotr0py <41363108+Isotr0py@users.noreply.github.com> Co-authored-by:
Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by:
Michael Goin <mgoin64@gmail.com> Co-authored-by:
Isotr0py <mozf@mail2.sysu.edu.cn>
-
- 29 Jan, 2025 2 commits
-
-
Alphi authored
Signed-off-by:
hzh <hezhihui_thu@163.com> Signed-off-by:
Sungjae Lee <33976427+llsj14@users.noreply.github.com> Signed-off-by:
shaochangxu.scx <shaochangxu.scx@antgroup.com> Signed-off-by:
DarkLight1337 <tlleungac@connect.ust.hk> Signed-off-by:
NickLucche <nlucches@redhat.com> Signed-off-by:
Roger Wang <ywang@roblox.com> Signed-off-by:
Rafael Vasquez <rafvasq21@gmail.com> Signed-off-by:
Akshat Tripathi <akshat@krai.ai> Signed-off-by:
Oleg Mosalov <oleg@krai.ai> Signed-off-by:
Jee Jee Li <pandaleefree@gmail.com> Signed-off-by:
rshaw@neuralmagic.com <rshaw@neuralmagic.com> Signed-off-by:
Yida Wu <yidawu@alumni.cmu.edu> Signed-off-by:
Chenguang Li <757486878@qq.com> Signed-off-by:
youkaichao <youkaichao@gmail.com> Signed-off-by:
Alex-Brooks <Alex.brooks@ibm.com> Signed-off-by:
Chen Zhang <zhangch99@outlook.com> Signed-off-by:
Shanshan Shen <467638484@qq.com> Signed-off-by:
elijah <f1renze.142857@gmail.com> Signed-off-by:
Yikun <yikunkero@gmail.com> Signed-off-by:
mgoin <michael@neuralmagic.com> Signed-off-by:
Woosuk Kwon <woosuk.kwon@berkeley.edu> Signed-off-by:
Konrad Zawora <kzawora@habana.ai> Signed-off-by:
tjtanaa <tunjian.tan@embeddedllm.com> Signed-off-by:
wangxiyuan <wangxiyuan1007@gmail.com> Signed-off-by:
Rui Qiao <ruisearch42@gmail.com> Co-authored-by:
shaochangxu <85155497+shaochangxu@users.noreply.github.com> Co-authored-by:
sixgod <evethwillbeok@outlook.com> Co-authored-by:
Roger Wang <136131678+ywang96@users.noreply.github.com> Co-authored-by:
Akshat Tripathi <Akshat.tripathi6568@gmail.com> Co-authored-by:
Avshalom Manevich <12231371+avshalomman@users.noreply.github.com> Co-authored-by:
Robert Shaw <114415538+robertgshaw2-neuralmagic@users.noreply.github.com> Co-authored-by:
Yangcheng Li <liyangcheng.lyc@alibaba-inc.com> Co-authored-by:
Siyuan Li <94890248+liaoyanqing666@users.noreply.github.com> Co-authored-by:
Concurrensee <yida.wu@amd.com> Co-authored-by:
elijah <30852919+e1ijah1@users.noreply.github.com> Co-authored-by:
Steve Luo <36296769+SunflowerAries@users.noreply.github.com> Co-authored-by:
TJian <tunjian1996@gmail.com> Co-authored-by:
maang-h <55082429+maang-h@users.noreply.github.com> Co-authored-by:
Elfie Guo <164945471+elfiegg@users.noreply.github.com> Co-authored-by:
Rui Qiao <161574667+ruisearch42@users.noreply.github.com> Co-authored-by:
-
Harry Mellor authored
Signed-off-by:
-
- 28 Jan, 2025 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 23 Jan, 2025 1 commit
-
-
Isotr0py authored
Signed-off-by:
-
- 20 Jan, 2025 1 commit
-
-
Isotr0py authored
Signed-off-by:
-
- 19 Jan, 2025 1 commit
-
-
Roger Wang authored
Signed-off-by:
imkero <kerorek@outlook.com> Co-authored-by:
-
- 18 Jan, 2025 1 commit
-
-
Isotr0py authored
Signed-off-by:
-
- 16 Jan, 2025 1 commit
-
-
Isotr0py authored
Signed-off-by:
-
- 15 Jan, 2025 1 commit
-
-
RunningLeon authored
-
- 12 Jan, 2025 2 commits
-
-
Isotr0py authored
Signed-off-by:
-
Rafael Vasquez authored
Signed-off-by:
-
- 10 Jan, 2025 1 commit
-
-
Harry Mellor authored
Signed-off-by:
-
- 09 Jan, 2025 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 07 Jan, 2025 4 commits
-
-
Cyrus Leung authored
Signed-off-by: -
Roger Wang authored
Signed-off-by: -
Roger Wang authored
Signed-off-by: -
Cyrus Leung authored
Signed-off-by:
-
- 06 Jan, 2025 2 commits
-
-
Roger Wang authored
[V1] Extend beyond image modality and support mixed-modality inference with Llava-OneVision (#11685) Signed-off-by:
-
Cyrus Leung authored
Signed-off-by:
-
- 01 Jan, 2025 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 31 Dec, 2024 2 commits
-
-
Roger Wang authored
Signed-off-by:
-
Matthias Vogler authored
Signed-off-by:
Matthias Vogler <matthias.vogler@joesecurity.org> Signed-off-by:
-
- 29 Dec, 2024 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 28 Dec, 2024 3 commits
-
-
youkaichao authored
Signed-off-by: -
Cyrus Leung authored
Signed-off-by: -
Isotr0py authored
Signed-off-by:
-
- 27 Dec, 2024 2 commits
-
-
Cyrus Leung authored
Signed-off-by: -
Simon Mo authored
Signed-off-by:simon-mo <simon.mo@hey.com>
-
- 26 Dec, 2024 1 commit
-
-
Roger Wang authored
Signed-off-by:
-
- 25 Dec, 2024 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 24 Dec, 2024 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
-
- 23 Dec, 2024 1 commit
-
-
Rafael Vasquez authored
Signed-off-by:
-
- 19 Dec, 2024 2 commits
-
-
Yehoshua Cohen authored
Signed-off-by:
Yehoshua Cohen <yehoshuaco@ai21.com> Signed-off-by:
-
Travis Johnson authored
Signed-off-by:Travis Johnson <tsjohnso@us.ibm.com>
-
- 16 Dec, 2024 1 commit
-
-
Jani Monoses authored
-
- 13 Dec, 2024 1 commit
-
-
Jani Monoses authored
-
- 12 Dec, 2024 1 commit
-
-
Pooya Davoodi authored
Signed-off-by:Pooya Davoodi <pooya.davoodi@parasail.io>
-
- 11 Dec, 2024 2 commits
-
-
Cyrus Leung authored
Signed-off-by: -
Mor Zusman authored
Signed-off-by:mzusman <mor.zusmann@gmail.com>
-
