GitLab

* [Enhance] Support FP16 for MSDeformAttn

* [Fix] Data type mismatch

* Update mmcv/ops/multi_scale_deform_attn.py

* Add UT

Author:    nijkah <nijkah@gmail.com>

* Add cuda available condition

---------
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support MsDeformAttnForward with cambricon MLU backend

* [Feature] Support ms with cambricon MLU backend

* [Feature] Support msdeformattn_1104 with cambricon MLU backend

* [Feature] Support ms with cambricon MLU backend

* [Feature] Support MsDeformAttn_1108 with cambricon MLU backend

* [Feature] Support MsDeformAttn_1108 with cambricon MLU backend

* [Feature] Support MsDeformAttn_1108 with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* Revert "[Feature] Support MsDeformAttn with cambricon MLU backend"

This reverts commit 27963cccc86d240852a40a2c1510147a3e9f269f.

* [Feature] Support MsdeformAttn with cambricon MLU backend

* [Feature] Support MsDeformAttn with cambricon MLU backend

* [Feature] Support MsdeformAttn with cambricon MLU backend
Co-authored-by: zhangshaopeng <wicky-zheng@outlook.com>
Co-authored-by: wicky-zheng <root@notebook-mmcv-290m8-torch1-6-y0yv66-notebook-0.notebook-mmcv-290m8-torch1-6-y0yv66.ns-ad8b689a0ecd41fcb4469c803dcd539d.svc.cluster.local>

* Upgrade the versions of pre-commit hooks

* update the versions of zh-cn.yaml

* add pyupgrade

* add options for pyupgrade

* minor refinement

* first commit

* Add copyright pre-commit-hook

* fix MultiScaleDeformableAttention inference issue on cpu model

* fix lint

* add unintest

* remove some code

* Update tests/test_ops/test_ms_deformable_attn.py
Co-authored-by: Zaida Zhou <58739961+zhouzaida@users.noreply.github.com>

* fix device

* remove device

* add more device

* refactor unittest
Co-authored-by: zhicheng huang <zhichenghzc@gmail.com>
Co-authored-by: zhangshilong <2392587229zsl@gmail.com>
Co-authored-by: Shilong Zhang <61961338+jshilong@users.noreply.github.com>

* minor changes

* change to modulist

* change to Sequential

* replace dropout with attn_drop and proj_drop in MultiheadAttention

* add operation_name for attn

* add drop path and move all ffn args to ffncfgs

* fix typo

* fix a bug when use default value of ffn_cfgs

* fix ffns

* add deprecate warning

* fix deprecate warning

* change to pop kwargs

* support register FFN of transformer

* support batch first

* fix batch first wapper

* fix forward wapper

* fix typo

* fix lint

* add unitest for transformer

* fix unitest

* fix equal

* use allclose

* fix comments

* fix comments

* change configdict to dict

* move drop to a file

* add comments for drop path

* add noqa 501

* move bnc wapper to MultiheadAttention

* move bnc wapper to MultiheadAttention

* use dep warning

* resolve comments

* add unitest:

* rename residual to identity

* revert runner

* msda residual to identity

* rename inp_identity to identity

* fix name

* fix transformer

* remove key in msda

* remove assert for key
Co-authored-by: HIT-cwh <2892770585@qq.com>
Co-authored-by: bkhuang <congee524@gmail.com>
Co-authored-by: Wenwei Zhang <40779233+ZwwWayne@users.noreply.github.com>

* add c++ ms_deform_atten

* fix cpp lint

* fix cpp lint

* clang format

* remove cmakefile

* google style

* clang-format precommit

* use clang-format-lint-action

* add transformer base class

* add merge

* add docstr

* add pyargs

* fix according to commments

* resiger module

* change to use basemodule

* add _ between build function

* split the name

* fix according to comments

* fix lint and fix unitest

* fix cpp lint

* fix bug of deformdetr_atten

* fix drop out

* fix residual

* use CUDA_1D_KERNEL_LOOP