GitLab

* [misc] update pre-commit

* [misc] run pre-commit

* [misc] remove useless configuration files

* [misc] ignore cuda for clang-format

This reverts commit 35c8f4ce.

* gh: move CONTRIBUTING to .github

* chore: move isort config to pyproject

* chore: move pytest config to pyproject

* chore: move yapf config to pyproject

* chore: move clang-format config to pre-commit

* [workflow] fixed the precommit CI

* polish file

* polish file

* update pre-commit

* update pre-commit

This reverts commit bef05489b642385c80e59fe757d598efd1752ecf.

Decreased moe tests;

Added FFNExperts and ViTMoE model

added branch context;
added vocab parallel layers;
moved split_batch from load_batch to tensor parallel embedding layers;
updated gpt model;
updated unit test cases;
fixed few collective communicator bugs

* Update GitHub action and pre-commit settings

* Update GitHub action and pre-commit settings (#198)