GitLab

Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

Signed-off-by: Lifu Huang <lifu.hlf@gmail.com>

[CI] Remove unused imports with Ruff to pre-commit config, only to benchmarks/docs/examples folder (#3969)

[Fix] use `torch.cat` instead of `torch.concat` to prevent entering the `Autograd` backends. (#4466)

Co-authored-by: HandH1998 <1335248067@qq.com>

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: sleepcoo <sleepcoo@gmail.com>