"examples/offline_inference/llm_engine_example.py" did not exist on "2e0d3143844303136c8aefa4c7e7bac30fd26850"
- 11 Sep, 2024 1 commit
-
-
Yang Fan authored
Co-authored-by:
Roger Wang <136131678+ywang96@users.noreply.github.com> Co-authored-by:
DarkLight1337 <tlleungac@connect.ust.hk>
-
- 03 Sep, 2024 1 commit
-
-
Alexander Matveev authored
-
- 30 Aug, 2024 1 commit
-
-
afeldman-nm authored
-
- 29 Aug, 2024 1 commit
-
-
Alexander Matveev authored
-
- 28 Aug, 2024 2 commits
-
-
Alexander Matveev authored
-
Cyrus Leung authored
-
- 27 Aug, 2024 1 commit
-
-
Megha Agarwal authored
Co-authored-by:Alexander Matveev <alexm@neuralmagic.com>
-
- 22 Aug, 2024 1 commit
-
-
Abhinav Goyal authored
-
- 19 Aug, 2024 2 commits
-
-
William Lin authored
Co-authored-by:afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
-
SangBin Cho authored
-
- 14 Aug, 2024 1 commit
-
-
William Lin authored
-
- 09 Aug, 2024 4 commits
-
-
Mahesh Keralapura authored
-
Alexander Matveev authored
-
Alexander Matveev authored
-
Cyrus Leung authored
-
- 06 Aug, 2024 1 commit
-
-
afeldman-nm authored
[Core] Subclass ModelRunner to support cross-attention & encoder sequences (towards eventual encoder/decoder model support) (#4942) Co-authored-by:
Andrew Feldman <afeld2012@gmail.com> Co-authored-by:
Nick Hill <nickhill@us.ibm.com>
-
- 02 Aug, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 30 Jul, 2024 1 commit
-
-
Nick Hill authored
-
- 26 Jul, 2024 1 commit
-
-
Peng Guanwen authored
-
- 22 Jul, 2024 1 commit
-
-
Cyrus Leung authored
Co-authored-by:Roger Wang <ywang@roblox.com>
-
- 19 Jul, 2024 1 commit
-
-
Antoni Baum authored
-
- 10 Jul, 2024 1 commit
-
-
sroy745 authored
[Speculative Decoding] Enabling bonus token in speculative decoding for KV cache based models (#5765)
-
- 09 Jul, 2024 1 commit
-
-
Swapnil Parekh authored
Co-authored-by:
Swapnil Parekh <swapnilp@ibm.com> Co-authored-by:
Joe G <joseph.granados@h2o.ai> Co-authored-by:
Antoni Baum <antoni.baum@protonmail.com>
-
- 03 Jul, 2024 1 commit
-
-
Cyrus Leung authored
Signed-off-by:
Xiaowei Jiang <xwjiang2010@gmail.com> Co-authored-by:
xwjiang2010 <87673679+xwjiang2010@users.noreply.github.com> Co-authored-by:
-
- 02 Jul, 2024 4 commits
-
-
Mor Zusman authored
Signed-off-by:
Muralidhar Andoorveedu <muralidhar.andoorveedu@centml.ai> Co-authored-by:
Erez Schwartz <erezs@ai21.com> Co-authored-by:
Mor Zusman <morz@ai21.com> Co-authored-by:
tomeras91 <57313761+tomeras91@users.noreply.github.com> Co-authored-by:
Tomer Asida <tomera@ai21.com> Co-authored-by:
Zhuohan Li <zhuohan123@gmail.com> Co-authored-by:
-
Murali Andoorveedu authored
Signed-off-by: -
xwjiang2010 authored
Signed-off-by:
Cyrus Leung <cyrus.tl.leung@gmail.com> Co-authored-by:
-
Alexander Matveev authored
-
- 29 Jun, 2024 1 commit
-
-
Antoni Baum authored
-
- 28 Jun, 2024 2 commits
-
-
Cody Yu authored
-
Cyrus Leung authored
Co-authored-by:
-
- 27 Jun, 2024 1 commit
-
-
youkaichao authored
-
- 26 Jun, 2024 1 commit
-
-
Stephanie Wang authored
Signed-off-by:
Stephanie Wang <swang@cs.berkeley.edu> Signed-off-by:
Stephanie <swang@anyscale.com> Co-authored-by:
-
- 21 Jun, 2024 1 commit
-
-
Joshua Rosenkranz authored
Signed-off-by:
Thomas Parnell <tpa@zurich.ibm.com> Co-authored-by:
Davis Wertheimer <Davis.Wertheimer@ibm.com>
-
- 18 Jun, 2024 1 commit
-
-
Ronen Schaffer authored
This PR adds basic support for OpenTelemetry distributed tracing. It includes changes to enable tracing functionality and improve monitoring capabilities. I've also added a markdown with print-screens to guide users how to use this feature. You can find it here
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 03 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 29 May, 2024 2 commits
-
-
Cyrus Leung authored
-
afeldman-nm authored
[Core] Cross-attention KV caching and memory-management (towards eventual encoder/decoder model support) (#4837)
-
- 28 May, 2024 1 commit
-
-
Cyrus Leung authored
Co-authored-by:
-
