GitLab

Co-authored-by: helloyongyang <yongyang1030@163.com>

1. 修复之前的代码合并冲突，并测试通过。

---------
Co-authored-by: Yang Yong (雍洋) <yongyang1030@163.com>

Thanks to HunyuanVideo Team and ModelTC Team.

---------
Co-authored-by: gushiqiao <975033167@qq.com>
Co-authored-by: gushiqiao <77222802+gushiqiao@users.noreply.github.com>
Co-authored-by: chendingyu <chendingyu1@sensetime.com>
Co-authored-by: XHPlus <xhplus@163.com>
Co-authored-by: wangshankun <wangshankun2011@hotmail.com>
Co-authored-by: STwangyingrui <86730325+STwangyingrui@users.noreply.github.com>
Co-authored-by: root <root@pt-80f094c20fc44a8cad096e5f3dbc962e-worker-0.pt-80f094c20fc44a8cad096e5f3dbc962e.ns-devsft-3460edd0.svc.cluster.local>

Feature:
    1. added mlu590 bfloat16, single-gpu and multi-gpus inference.
    2. added mlu590 int8 inference.

Co-authored-by: root <root@pt-731f15f5c62740f495519352dc90d9c4-worker-0.pt-731f15f5c62740f495519352dc90d9c4.ns-devsft-3460edd0.svc.cluster.local>

support self-forcing wan2.1 dmd

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* [Feat] Support vae bf16 and add 4090 best config

* update dtype

---------
Co-authored-by: helloyongyang <yongyang1030@163.com>

* [Feat] audio driven for wan2.2-r2v-5b

* refactor: reduce vae args dim &&  timestep init

* update audio pre_infer

* update runner

* update scripts

* [Fix] move ref timestep padding to Scheduler

* fix wan i2v

---------
Co-authored-by: helloyongyang <yongyang1030@163.com>

* fix a image cat bug in parallel vae

* async offload & context4debug

* offload ratio

* Merge branch 'main' into xinchi/fix_offload

* adding offload ratio

* pre-commit

---------
Co-authored-by: “de1star” <“843414674@qq.com”>

* fix offload

* fix offload

---------
Co-authored-by: “de1star” <“843414674@qq.com”>

Co-authored-by: gushiqiao <gushiqiao@sensetime.com>

* [minor]: optimize dockerfile for fewer layer

* [feature]: add pre-commit lint, update readme for contribution guidance

* [minor]: fix run shell privileges

* [auto]: first lint without rule F, fix rule E

* [minor]: fix docker file error

* 修改了main.py, t5的model, wan的model、三个weights文件和三个infer文件, 并且在common的conv3d算子中注册新算子

* 修改了Conv3dWeightForceBF16算子，更新了wan的pre_weights中对此算子的使用

* 修复了import中的bug

* 修复了WanPreWeights, WanTransformerWeights没有self.config的bug

* 修复了WanPreWeights, WanTransformerWeights没有self.config的bug

* 修复了config的bug，目前在使用cpu_offload的时候，vae阶段有tensor不在同一device的bug

* 修复了vae阶段迁移的bug

* 修复了scale在mean和inv_std迁移后仍需重新赋值的bug