GitLab

support full evoformer tracer, which is a main module of alphafold. previously we just support a simplifed version of it.
1. support some evoformer's op in fx
2. support evoformer test
3. add repos for test code

Co-authored-by: Ziyue Jiang <ziyue.jiang@gmail.com>

* [example] update vit ci script

* [example] update requirements

* [example] update requirements

* [example] integrate autoparallel demo with CI

* polish code

* polish code

* polish code

* polish code

* [examples] update autoparallel tutorial demo

* add test_ci.sh

* polish

* add conda yaml

* Update initialize.py

* pre-commit run check

* [workflow] automated bdist wheel build

* polish workflow

* polish readme

* polish readme

* [autoparallel] update binary elementwise handler

* polish

* [workflow] automated the compatiblity test

* polish code

* [example] updated large-batch optimizer tutorial

* polish code

* polish code

* [example] updated the hybrid parallel tutorial

* polish code

* [ddp] add is_ddp_ignored

[ddp] rename to is_ddp_ignored

* [zero] fix state_dict and load_state_dict

* fix bugs

* [zero] update unit test for ZeroDDP

* [autoparallel] integrate device mesh initialization into autoparallelize

* add megatron solution

* update gpt autoparallel examples with latest api

* adapt beta value to fit the current computation cost