- 11 Dec, 2024 1 commit
-
-
王敏 authored
-
- 07 Dec, 2024 1 commit
-
-
youkaichao authored
Signed-off-by:youkaichao <youkaichao@gmail.com>
-
- 02 Dec, 2024 1 commit
-
-
Kuntai Du authored
This PR provides initial support for single-node disaggregated prefill in 1P1D scenario. Signed-off-by:
KuntaiDu <kuntai@uchicago.edu> Co-authored-by:
ApostaC <yihua98@uchicago.edu> Co-authored-by:
YaoJiayi <120040070@link.cuhk.edu.cn>
-
- 27 Nov, 2024 2 commits
-
-
王敏 authored
2.更新medusa readme 3.解决benchmark_moe报错问题
-
Chendi.Xue authored
Signed-off-by:Chendi Xue <chendi.xue@intel.com>
-
- 22 Nov, 2024 1 commit
-
-
youkaichao authored
Signed-off-by:
Nick Hill <nhill@redhat.com>
-
- 06 Nov, 2024 1 commit
-
-
王敏 authored
2.examples中添加medusa readme 3.修复model_runner中input_positions配置错误的笔误，解决多个模型运行失败问题
-
- 02 Nov, 2024 1 commit
-
-
youkaichao authored
Signed-off-by:
-
- 24 Oct, 2024 1 commit
-
-
王敏 authored
-
- 30 Aug, 2024 1 commit
-
-
afeldman-nm authored
-
- 28 Aug, 2024 1 commit
-
-
Alexander Matveev authored
-
- 27 Aug, 2024 1 commit
-
-
Megha Agarwal authored
Co-authored-by:Alexander Matveev <alexm@neuralmagic.com>
-
- 22 Aug, 2024 1 commit
-
-
Abhinav Goyal authored
-
- 19 Aug, 2024 1 commit
-
-
William Lin authored
Co-authored-by:afeldman-nm <156691304+afeldman-nm@users.noreply.github.com>
-
- 13 Aug, 2024 1 commit
-
-
youkaichao authored
-
- 11 Aug, 2024 1 commit
-
-
William Lin authored
-
- 09 Aug, 2024 1 commit
-
-
Mahesh Keralapura authored
-
- 02 Aug, 2024 1 commit
-
-
Rui Qiao authored
Support pipeline-parallelism with Ray accelerated DAG. Signed-off-by:Rui Qiao <ruisearch42@gmail.com>
-
- 01 Aug, 2024 1 commit
-
-
Aurick Qiao authored
Co-authored-by:Aurick Qiao <aurick.qiao@snowflake.com>
-
- 22 Jul, 2024 1 commit
-
-
Woosuk Kwon authored
-
- 20 Jul, 2024 1 commit
-
-
Antoni Baum authored
-
- 19 Jul, 2024 1 commit
-
-
Nick Hill authored
Co-authored-by:Murali Andoorveedu <muralidhar.andoorveedu@centml.ai>
-
- 18 Jul, 2024 1 commit
-
-
Rui Qiao authored
Signed-off-by:
Stephanie Wang <swang@cs.berkeley.edu>
-
- 12 Jul, 2024 1 commit
-
-
Hongxia Yang authored
-
- 02 Jul, 2024 2 commits
-
-
Mor Zusman authored
Signed-off-by:
Erez Schwartz <erezs@ai21.com> Co-authored-by:
Mor Zusman <morz@ai21.com> Co-authored-by:
tomeras91 <57313761+tomeras91@users.noreply.github.com> Co-authored-by:
Tomer Asida <tomera@ai21.com> Co-authored-by:
Zhuohan Li <zhuohan123@gmail.com> Co-authored-by:
-
Murali Andoorveedu authored
Signed-off-by:
-
- 28 Jun, 2024 1 commit
-
-
Cody Yu authored
-
- 26 Jun, 2024 1 commit
-
-
Stephanie Wang authored
Signed-off-by:
Stephanie <swang@anyscale.com> Co-authored-by:
-
- 25 Jun, 2024 1 commit
-
-
Matt Wong authored
-
- 21 Jun, 2024 1 commit
-
-
rohithkrn authored
-
- 15 Jun, 2024 1 commit
-
-
Cyrus Leung authored
-
- 29 May, 2024 1 commit
-
-
youkaichao authored
-
- 22 May, 2024 1 commit
-
-
Nick Hill authored
-
- 16 May, 2024 1 commit
-
-
Cody Yu authored
Co-authored-by:
Cade Daniel <edacih@gmail.com> Co-authored-by:
Cade Daniel <cade@anyscale.com>
-
- 04 May, 2024 1 commit
-
-
Cody Yu authored
-
- 25 Apr, 2024 1 commit
-
-
Nick Hill authored
-
- 23 Apr, 2024 2 commits
- 18 Apr, 2024 2 commits
-
-
youkaichao authored
[Core] add an option to log every function call to for debugging hang/crash in distributed inference (#4079) Co-authored-by:Simon Mo <simon.mo@hey.com>
-
SangBin Cho authored
Co-authored-by:SangBin Cho <sangcho@sangcho-LT93GQWG9C.local>
-
