GitLab

**Description**
Bug fix to sync latest megatron-lm code.

**Description**
Benchmarks: Micro benchmarks - add fp8 and initialization for hipblaslt
benchmark.

**Description**
Benchmarks: Micro benchmarks - Update hipblaslt metric unit to tflops

**Description**
Adapt to hipblasLt data type changes.

**Description**
Bug fix for rocm docker build and deploy.

**Description**
Introduce option for fine-grained GPU memory for AMD GPUs, which should
include GPU P2P performance.

**Description**
Make metrics of dist-inference-cpp aligned with PyTorch version.

---------
Co-authored-by: Yuting Jiang <yutingjiang@microsoft.com>

**Description**
Add data type option for NCCL and RCCL tests.

**Description**
Add in-place metrics for NCCL/RCCL benchmark for latency measurement.

**Description**
Support different data types in different hipblasLt versions for
dist_inference

**Description**
`add_compile_options` will not work for ROCm build, change it to setting
`CMAKE_CXX_FLAGS`.

**Description**
Add distributed inference benchmark cpp implementation.

**Description**
upgrade to rocm5.7 dockerfile.

---------
Co-authored-by: yukirora <yuting.jiang@microsoft.com>

Benchmarks: Micro benchmark - Add one-to-all, all-to-one, all-to-all support to gpu_copy_bw_performance (#588)

**Description**
Add one-to-all, all-to-one, all-to-all support to
gpu_copy_bw_performance, and fix performance bug in gpu_copy

**Description**
Megatron-LM/Megatron-Deepspeed GPT pretrain benchmark

**Description**
Revise NCCL/RCCL benchmarks to graph mode add latency metrics.

**Description**
Benchmarks: micro benchmark - Support cpu-gpu and gpu-cpu in
ib-validation

**Major Revision**
- Support cpu-gpu and gpu-cpu in ib-validation


**Minor Revision**
- support multi msg size, multi direction, multi ib commands in
ib-validation

Upgrade Docker image to CUDA 12.2 for H100:
* upgrade base image to 23.10
* fix onnxruntime version in python3.10
* fix compilation errors

**Description**
add initialization options for rocm gemm flops.

**Description**
hipblaslt function benchmark and rebase cublaslt function benchmark.

**Description**
add int8 support for cublaslt function.

**Description**
remove cp ptx file in gpu burn test since the command is run inside
self.args.bin_dir dir.


https://github.com/microsoft/superbenchmark/blob/d246bab430adeb461072918a551b2e2b68c9bce5/superbench/benchmarks/micro_benchmarks/micro_base.py#L183

**Description**
source code for evaluating NVDEC decoding performance.

---------
Co-authored-by: yukirora <yuting.jiang@microsoft.com>

**Description**
add source code for DirectXRenderPerf.

---------
Co-authored-by: yukirora <yuting.jiang@microsoft.com>

**Description**
Cherry-pick bug fixes from v0.9.0 to main.

**Major Revision**
- CI/CD: pipeline - clean more disk space to fix rocm building image
pipeline(#555 )
- Benchmarks: bug fix - use absolute path for input file in
DirectXEncodingLatency(#554)
- CI/CD - add push win docker image on release branch in pipeline (#552)
- Docs - Upgrade version and release note(#557)

**Description**
add python code for DirectXGPUEncodingLatency.

**Description**
add python code for DirectXGPUCopy.

**Description**
add python code for DirecXGPUMemBw.

**Description**
add python code for DirectX core flops and init DirectX test pipeline.

**Major Revision**
- add python code for DirectX core flops 
- init DirectX test pipeline


**Minor Revision**
- add test for DirectX core flops

**Description**
Support DirectX test pipeline.

**Description**
add auto selecting algorithm support for cudnn functions.

**Major Revision**
- add auto selecting algorithm support for cudnn functions in source
code
- add 'auto_algo' option in benchmark
- add related test

* Update result parsing for newer tensorrt versions
* Update arguments when load torchvision models

**Description**
Add source code of DirectxGPUCopy microbenchmark.

**Description**
Add source code of DirectxGPUMemBw microbenchmark.

---------
Co-authored-by: v-junlinlv <v-junlinlv@microsoft.com>

**Description**
Add source code of DirectXGPUCoreFLOPs microbenchmark.

---------
Co-authored-by: v-junlinlv <v-junlinlv@microsoft.com>

**Description**
Add dockerfile for win10 and building script for directx_benchmarks.

**Major Revision**
- Add docker file for win10 and required scripts to install the
dependency
- Add building script to build all directx vs benchmarks
- Add call of building script in Makefile

---------
Co-authored-by: yukirora <yuting.jiang@microsoft.com>
Co-authored-by: Yifan Xiong <yifan.xiong@microsoft.com>

**Description**
Add support for DirectX GPU platform.

**Major Revision**
- Add DirectX platform for benchmark registry
- Add gpu_vendor identify for AMD and NVIDIA with win driver

**Description**
Update 404 outdate reference links.

**Description**
Model benchmarks can stop due to `num_steps` or `duration` config which
will take effect when the value is set greater than 0.
If both are set greater than 0, the earliest condition reached will
work.

**Description**
This commit revises distributed inference benchmark to give a unified
step time result by taking maximum step times of different GPUs.