GitLab

Fix gemma 3 launch with `transformers:` the error: `AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size'` (#9614)

Co-authored-by: a4zhangfei <a4zhangfei@qq.com>

Signed-off-by: lbk-sys <hello_lbk@163.com>
Signed-off-by: libaokui <libaokui@hauwei.com>
Co-authored-by: libaokui <libaokui@hauwei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>

Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

[Fix] RuntimeError: get_cfg Unsupported input_type:Float4_e2m1fn_x2 in using aiter-mxfp4-moe (#10981)
Co-authored-by: wunhuang <wunhuang@amd.com>

Signed-off-by: PanJason <pyyjason@gmail.com>

Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>

Signed-off-by: Anqi Shen <amy.saq@antgroup.com>

Co-authored-by: Lianmin Zheng <lianminzheng@gmail.com>
Co-authored-by: sglang-bot <sglangbot@gmail.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>

Signed-off-by: Shangming Cai <csmthu@gmail.com>
Co-authored-by: Shangming Cai <csmthu@gmail.com>

Co-authored-by: eraser00 <eraser00@github.com>

Co-authored-by: Yingchun Lai <laiyingchun@apache.org>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>