GitLab

[ROCm] Enable VLLM triton FP8 moe for gfx1201, tuned for Qwen3-30B-A3B-FP8 tp=2 and Qwen/Qwen3.5-35B-A3B-FP8 tp=2 (#38086)
Signed-off-by: big-yellow-duck <jeffaw99@hotmail.com>
Co-authored-by: vllmellm <vllm.ellm@embeddedllm.com>

Signed-off-by: Luka Govedič <lgovedic@redhat.com>
Signed-off-by: Xinyu Chen <xinyu1.chen@intel.com>
Signed-off-by: chzhang <chaojun.zhang@intel.com>
Signed-off-by: Luka Govedic <luka.govedic@gmail.com>
Co-authored-by: Xinyu Chen <xinyu1.chen@intel.com>
Co-authored-by: Chaojun Zhang <chaojun.zhang@intel.com>
Co-authored-by: Luka Govedič <ProExpertProg@h100-01.nemg-001.lab.rdu2.dc.redhat.com>

Signed-off-by: Liao, Wei <wei.liao@intel.com>
Signed-off-by: wliao2 <wei.liao@intel.com>
Signed-off-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Harry Mellor <19981378+hmellor@users.noreply.github.com>
Co-authored-by: Kunshang Ji <kunshang.ji@intel.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>

Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>
Signed-off-by: Micah Williamson <micah.williamson@amd.com>
Co-authored-by: Micah Williamson <micah.williamson@amd.com>

Signed-off-by: Robert Shaw <robshaw@redhat.com>
Co-authored-by: Robert Shaw <robshaw@redhat.com>

Signed-off-by: Tiffany Mintz <Tiffany.Mintz@amd.com>

Signed-off-by: Divakar Verma <divakar.verma@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: jennyyyyzhen <yzhen@hmc.edu>
Co-authored-by: Lu Fang <30275821+houseroad@users.noreply.github.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: Sage Moore <sage@neuralmagic.com>

Signed-off-by: Naina Kuruballi Mahesh <nainakm@meta.com>

Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Yongji Wu <wuyongji317@gmail.com>
Signed-off-by: Itay Alroy <ialroy@nvidia.com>
Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Signed-off-by: Ron Tourgeman <rtourgeman@nvidia.com>
Co-authored-by: Yongji Wu <wuyongji317@gmail.com>
Co-authored-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Co-authored-by: Ron Tourgeman <rtourgeman@nvidia.com>

[ROCm] Add extra step in config initialization to populate custom ops before compilation config init (#34848)
Signed-off-by: Gregory Shtrasberg <Gregory.Shtrasberg@amd.com>

Signed-off-by: Kunshang Ji <kunshang.ji@intel.com>
Signed-off-by: Kunshang Ji <jikunshang95@gmail.com>

Signed-off-by: Rohan138 <rohanpotdar138@gmail.com>

Signed-off-by: badaoui <abdennacerbadaoui0@gmail.com>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>
Signed-off-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <lwilkins@redhat.com>
Co-authored-by: Lucas Wilkinson <LucasWilkinson@users.noreply.github.com>

Signed-off-by: Andreas Karatzas <akaratza@amd.com>

Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

Signed-off-by: Kourosh Hakhamaneshi <kourosh@anyscale.com>

Signed-off-by: carlory <baofa.fan@daocloud.io>
Co-authored-by: Claude Opus 4.5 <noreply@anthropic.com>

Signed-off-by: Paco Xu <paco.xu@daocloud.io>

Signed-off-by: mohammad najafi <mohammad.najafi@amd.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>

Signed-off-by: Alex Sun <alex.s@amd.com>

Signed-off-by: yewentao256 <zhyanwentao@126.com>

Signed-off-by: ganyi <ygan@amd.com>

Signed-off-by: Hongxia Yang <hongxia.yang@amd.com>

Signed-off-by: Matthew Wong <Matthew.Wong2@amd.com>

Signed-off-by: Matthew Bonanni <mbonanni@redhat.com>

Signed-off-by: Isotr0py <mozf@mail2.sysu.edu.cn>

[ROCm][Bugfix] Fix accuracy issue on fmoe when `VLLM_ROCM_USE_AITER_FUSION_SHARED_EXPERTS` enabled (#31523)
Signed-off-by: ganyi <ygan@amd.com>