GitLab

Implement ansible client and runner:
* add ansible client
* add deploy and check_env playbooks

* add kernel launch overhead benchmark.

* add cuda kernel launch overhead benchmark - source part.
* can customize the nvcc_archs_support.
* set SB_MICRO_PATH for azure pipeline tests.

* call build script in Makefile.
* add cppbuild command for testing and docker env.

* use absolute path of input file
* parse registry uri from image
* merge common parts for arguments processing

* add GitHub Action to build and push image
* update Dockerfile to copy from context

* add script to build all native benchmarks with cmake.

__Major Revisions__

* add clang-format to lint cpp sources
* add cpp lint in GitHub Actions

* Revise MicroBenchmark class to be more flexible.
* use command index not the command as the parameter.
* changes according to discussion.

__Major Revision__

* Support lazy import.
* Not importing benchmarks when running `help`, `version`, `deploy` commands, etc.

* revise example settings of cnn models.

Speedup Azure pipeline for CPU unit test.

* Benchmarks: Add Benchmark - Add LSTM model benchmarks.

* Benchmarks: Add Benchmark - Add CNN model benchmarks.

Benchmarks: Code Revision - Fix some issue for BERT benchmark. (#58)

* Benchmarks: Add Benchmark - Add GPT2 model benchmark.

* Benchmarks: Add Feature - Add interface to get all predefine parameters of all benchmarks.

* Benchmarks: Add Benchmark - add computation and communication overlap micro benchmark

* Benchmarks: Add benchmark - fix some format issues and typo

* Benchmarks: Add Benchmark - update according comments and add test

* revise tests

* skip multi gpu test due to no multi gpu
Co-authored-by: v-yujiang <v-yujiang@microsoft.com>

* Rename dev branch to main and set it as default.

* Superbenchmark: Revise tests - revise benchmark test util to support multi gpu test

* modify test_sharding_matmul.py to match the tests util

* update README for public view

* add flags for different pipelines to merge reports
* add token for cuda pipeline
* update codecov/patch target

* fix missing package in dockerfile
* update benchmark list and parameters
* catch runtime errors
* refine logging info

* add tests for matmul and sharding-matmul benchmarks.

* add decorator for sharding_matmul tests.

* add __init__.py for utils of benchmarks tests.

* disable GPU tests for CPU platform validation.

* fix typo
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
Co-authored-by: Peng Cheng <chengpeng5555@outlook.com>
Co-authored-by: Yifan Xiong <yifan.xiong@microsoft.com>

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
Co-authored-by: Yifan Xiong <yifan.xiong@microsoft.com>

* add azure pipelines for CUDA tests

* CLI integration with Executor and Runner

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

* add cuda11.1.1 dockerfile

* init runner class with not implemented

* skip unnecessary tests according to env var
* remove useless tests

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>

Add superbench executor class

* add executor class
* update default config to exec benchmarks
* add micro benchmarks and model benchmarks