GitLab

Co-authored-by: 刁莹煜 <diaoyingyu1@hisilicon.com>

Co-authored-by: wunhuang <wunhuang@amd.com>

Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Hubert Lu <Hubert.Lu@amd.com>

[CUTLASS-FP4-MOE]  Introduce CutlassMoEParams class for easy initialization of Cutlass Grouped Gems Metadata (#6887)
Signed-off-by: Pavani Majety <pmajety@nvidia.com>

Set `num_fused_shared_experts` as `num_shared_experts` when shared_experts fusion is not disabled (#6736)

Co-authored-by: Brayden Zhong <b8zhong@uwaterloo.ca>

Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>

Co-authored-by: Cheng Wan <cwan39@gatech.edu>
Co-authored-by: fzyzcjy <ch271828n@outlook.com>
Co-authored-by: ispobock <ispobaoke@163.com>

Co-authored-by: Zhang, Liangang <liangang.zhang@intel.com>

Support penalty in overlap mode; return logprob with chunked prefill; improve benchmark scripts (#3988)
Co-authored-by: SangBin Cho <rkooo567@gmail.com>
Co-authored-by: dhou-xai <dhou@x.ai>
Co-authored-by: Hanming Lu <hanming_lu@berkeley.edu>

Co-authored-by: Zhangyi <1109276519@qq.com>

Co-authored-by: Lin, Soga <soga.lin@amd.com>

Co-authored-by: wunhuang <wunhuang@amd.com>
Co-authored-by: Lin, Soga <soga.lin@amd.com>

Co-authored-by: SangBin Cho rkooo567@gmail.com