GitLab

Fix gemma 3 launch with `transformers:` the error: `AttributeError: 'TransformersForCausalLM' object has no attribute 'tp_size'` (#9614)

Co-authored-by: a4zhangfei <a4zhangfei@qq.com>

Co-authored-by: luoyuan.luo <luoyuan.luo@antgroup.com>
Co-authored-by: PGFLMG <1106310035@qq.com>

Signed-off-by: lbk-sys <hello_lbk@163.com>
Signed-off-by: libaokui <libaokui@hauwei.com>
Co-authored-by: libaokui <libaokui@hauwei.com>
Co-authored-by: Even Zhou <even.y.zhou@outlook.com>

Fix CI failure of TypeError: RotaryEmbedding.forward_cpu() got an unexpected keyword argument 'fused_set_kv_buffer_arg' (#11009)

[router][tool parser] Modify tool parser to return both normal text and tool calls (non-stream) (#10995)

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Signed-off-by: Shangming Cai <csmthu@gmail.com>

Co-authored-by: Xinyuan Tong <115166877+JustinTong0323@users.noreply.github.com>

Co-authored-by: yhyang201 <yhyang201@gmail.com>
Co-authored-by: Yangmin Li <yangminl@nvidia.com>
Co-authored-by: Yuan Luo <yuan.luo@hotmail.com>
Co-authored-by: gemini-code-assist[bot] <176961590+gemini-code-assist[bot]@users.noreply.github.com>

[Fix] RuntimeError: get_cfg Unsupported input_type:Float4_e2m1fn_x2 in using aiter-mxfp4-moe (#10981)
Co-authored-by: wunhuang <wunhuang@amd.com>

Signed-off-by: PanJason <pyyjason@gmail.com>

Co-authored-by: Teng Ma <sima.mt@alibaba-inc.com>

Signed-off-by: Hao Lu <14827759+hlu1@users.noreply.github.com>