GitLab

__Description__

Upgrade version and release note.

__Major Revision__

- Upgrade package versions
- Add release note for v0.4.0

**Description**
Unify metric and add doc for cuBLAS and cuDNN functions.

**Description**
Add usage for data diagnosis.

**Description**
Update docs for monitor.

Add transformers for TensorRT inference.

**Description**
Add benchmark metrics for cpu-memory-bw-latency.

**Description**
Minor doc change to highlight sb CLI version is independent of the sb container version.

**Description**
Add ONNXRuntime inference benchmark based on ORT python API.

**Major Revision**
- Add `ORTInferenceBenchmark` class to export pytorch model to onnx model and do inference
- Add tests and example for `ort-inference` benchmark
- Update the introduction docs.

**Description**
Integrate monitor into Superbench.

**Major Revision**
- Initialize, start and stop monitor in SB executor.
- Parse the monitor data in SB runner and merge into benchmark results.
- Specify ReduceType for monitor metrics, such as MAX, MIN and LAST.
- Add monitor configs into config file.

**Description**
Unify metric names of benchmarks.

**Description**
Add doc for data diagnosis, including input, output and baseline file schema.

**Description**
Update ib validtion mirobenchmark metrics.

**Description**

Update gpu-copy benchmark metrics.

__Description__

Add TensorRT inference benchmark for torchvision models.

__Major Revision__
- Measure TensorRT inference performance.

**Description**

Update docs to add network benchmarks for tcp and gpcnet.

Update docs to add ORT AMD benchmarks based on docker.

Add introduction and metrics for micro-benchmarks and model-benchmarks document.

**Description**
Revise the all the term `onnx` to `onnxruntime`.

__Major Revisions__

* Refine document structure for user tutorial.

__Minor Revisions__

* Add AMD part in installation.
* Change default config file to latest link.

**Description**

Cherry-pick  bug fixes from v0.3.0 to main.

**Major Revisions**
* Docs - Upgrade version and release note (#209)
* Benchmarks: Build Pipeline - Update rccl-test git submodule to dc1ad48 (#210)
* Benchmarks: Update - Update benchmarks in configuration file (#208)
* CI/CD - Update GitHub Action VM (#211)
* Benchmarks: Fix Bug - Fix wrong parameters for gpu-sm-copy-bw in configuration examples (#203)
* CI/CD - Fix bug in build image for push event (#205)
* Benchmark: Fix Bug - fix error message of communication-computation-overlap (#204)
* Tool: Fix bug - Fix function naming issue in system info  (#200)
* CI/CD - Push images in GitHub Action (#202)
* Bug - Fix torch.distributed command for single node (#201)
* CLI - Integrate system info for node (#199)
* Benchmarks: Code Revision - Revise CMake files for microbenchmarks. (#196)
* CI/CD - Add ROCm image build in GitHub Actions (#194)
* Bug: Fix bug - fix bug of hipBusBandwidth build (#193)
* Benchmarks: Build Pipeline - Restore rocblas build logic (#197)
* Bug: Fix Bug - Add barrier before 'destroy_process_group' in model benchmarks (#198)
* Bug - Revise 'docker run' in sb deploy (#195)
* Bug - Fix Bug : fix bug of error param operations to operation in rccl-bw of hpe config (#190)
Co-authored-by: Yuting Jiang <v-yujiang@microsoft.com>
Co-authored-by: Guoshuai Zhao <guzhao@microsoft.com>
Co-authored-by: Ziyue Yang <ziyyang@microsoft.com>

**Description**
Add system config info for result collection

**Description**
Revise results contributing rule.

- Change the results uploading path to [superbench-results](https://github.com/microsoft/superbench-results

) repo.
- Add description of how to get system info by command.
Co-authored-by: Peng Cheng <chengpeng5555@outlook.com>

**Description**
Add document for SuperBench YAML config file.

 Add config and docs for development experience.

__Major Revision__
- Add settings and extensions config for VSCode.
- Add devcontainer config for Codespaces.
- Update document accordingly.

**Description**
Change the field name `reduce` to `reduce_op`.

Add docs on:
* Docker image tag list
* Build image and run container instructions

Add ReduceType description into benchmarks doc.

**Description**
Add Executor and Benchmarks design doc

**Major Revision**
- Add Executor design doc
- Add Benchmarks design doc

__Description__
Cherry-pick bug fixes from v0.2.1 to main.

__Major Revisions__
* Fix bug of VGG models failed on A100 GPU with batch_size=128.
* Fix Ansible connection issue when running in localhost.
* Update version in packages and docs.

**Description**
Add result contributing rules

**Description**
Add release process document.

Update README and version for v0.2 release.

Support `--host-list` for deploy and run commands.

Before this change, an inventory file is needed to use `sb deploy/run`.
Now, `--host-list localhost` or `-l localhost` is sufficient for quick try.

* Support custom output directory.
* Update document.

* Add introduction and release documents.
* Fix some typos in documents.

Update SuperBench documents.