GitLab

Fixes `is_marlin` not being passed into `get_default_config`

Also allow `--tensor-parallel-size` in addition to `-tp` and `--tp-size`
Signed-off-by: Tyler Michael Smith <tyler@neuralmagic.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>

Signed-off-by: Junichi Sato <junichi.sato@sbintuitions.co.jp>

Signed-off-by: Roger Wang <ywang@roblox.com>

Signed-off-by: Junichi Sato <junichi.sato@sbintuitions.co.jp>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

Signed-off-by: Nick Hill <nhill@redhat.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: zibai <zibai.gj@alibaba-inc.com>
Co-authored-by: Roger Wang <136131678+ywang96@users.noreply.github.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: elijah <f1renze.142857@gmail.com>

Signed-off-by: Ren MinMin <renmm6@chinaunicom.cn>
Co-authored-by: Ren MinMin <renmm6@chinaunicom.cn>

Signed-off-by: Kuntai Du <kuntai@uchicago.edu>

Signed-off-by: Ye Qi <yeq@meta.com>
Co-authored-by: yeq <yeq@devgpu004.lla3.facebook.com>

Signed-off-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: KuntaiDu <kuntai@uchicago.edu>

Signed-off-by: Jiaxin Shan <seedjeffwan@gmail.com>

2.修复medusa推理时内存访问越界问题
3.benchmark_moe添加deepseek_v2模型

Signed-off-by: Varun Sundar Rabindranath <varun@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Co-authored-by: Faraz Shahsavan <faraz.shahsavan@gmail.com>
Co-authored-by: ilmarkov <markovilya197@gmail.com>
Co-authored-by: Rahul Tuli <rahul@neuralmagic.com>
Co-authored-by: rshaw@neuralmagic.com <rshaw@neuralmagic.com>

Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Xiaoyu Zhang <BBuf@users.noreply.github.com>

Signed-off-by: Alexander Matveev <alexm@neuralmagic.com>

Signed-off-by: luka <luka@neuralmagic.com>
Co-authored-by: Varun Sundar Rabindranath <varun@neuralmagic.com>

Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Michael Goin <michael@neuralmagic.com>

Signed-off-by: Aaron Pham <contact@aarnphm.xyz>
Signed-off-by: Chendi Xue <chendi.xue@intel.com>
Co-authored-by: Aaron Pham <contact@aarnphm.xyz>

This PR provides initial support for single-node disaggregated prefill in 1P1D scenario.
Signed-off-by: KuntaiDu <kuntai@uchicago.edu>
Co-authored-by: ApostaC <yihua98@uchicago.edu>
Co-authored-by: YaoJiayi <120040070@link.cuhk.edu.cn>

Signed-off-by: Roger Wang <ywang@roblox.com>
Co-authored-by: Chen Zhang <zhangch99@outlook.com>
Co-authored-by: Isotr0py <2037008807@qq.com>

2.更新medusa readme
3.解决benchmark_moe报错问题

Signed-off-by: Wang, Yi A <yi.a.wang@intel.com>

Signed-off-by: ElizaWszola <eliza@neuralmagic.com>

Signed-off-by: rickyx <rickyx@anyscale.com>

Signed-off-by: Lucas Wilkinson <lwilkinson@neuralmagic.com>